PhD here. You should only go to grad school now if you have a burning desire to do so. That option will not go away; in fact, with a year or two of work experience, your grad school options will be even greater.
PhD tracks are not just advanced college. It is more like being junior faculty (and when I say junior, I mean REALLY junior - you are at the bottom of the totem pole in priority in the department). And $35k a year will feel very low to you. You have to really love what you are doing in order to tolerate the sacrifices you will be making.
In a nutshell, if you have to ask the question at all, the answer is take the job. Grad school can wait until you can’t imagine doing anything else.
Most people who start PhD programs do not finish. Not because it is too intellectually demanding, but because it is not at all a fun experience. Of the class of 18 people I started with, 2 got their PhDs. It’s a long road, and only the most motivated finish (because there is no pot of gold at the end of that rainbow).