Doubting my abilities to go premed

A successful career should mix passion with aptitude. It is fine to major in something other than science, but understand that having an aptitude in science is critical. College is a time to explore. You may find a passion and aptitide for something that is not on your radar yet. If you want to begin your college career taking premed classes, that is fine, but you have not failed if you decide against being premed.
If you can, take a wide variety of courses as a freshman, visit career services for testing and ideas. If you still decide that you love medicine (after more shadowing and clinical volunteering) then jump into it.