Good for you for thinking it through. It could be that you need a gap year. I can completely understand just being exhausted after working so hard in HS and then having the thought of beginning it again so soon.
I knew without a doubt that I was going to college right after high school, and I'm glad I did, so if you are having doubts, it might be something to listen to.
Travel abroad during a semester or summers between college years could help fulfill the desire to travel.
Most likely, once you get to school and get caught up in the fun and challenge of college, you will realize it was a good choice to go on to college, but you don't know that until you go.
Talking to someone outside your immediate family would be a good idea. Maybe someone who took a gap year and someone who didn't.