In terms of college admissions, you’re on a perfectly fine math track and there’s no need to accelerate further. The only case where accelerating is actually relevant to improving one’s chances at most colleges in the US is if the student is set to take Algebra 2 senior year and is unable to get to Pre-Calculus or College Algebra before graduating high school.
Most colleges don’t expect Calculus, but you are right that they do expect physics, so take that eventually (even if it’s regular).