all science course in college assume no backgrounds in past. Just like any foreign languages courses. You will be scared by classmate that had previous exposure but after couple weeks, you should be able to know you indeed are capable. As long as you took Algebra 3 Honor/preCal and some Calculus as you stated, you have exposure to word problems in velocity, trajectory, vector etc. These are Physics problems. You should be fine. Usually there are algebra base and calculus base Physics courses in college. Pick whatever you feel comfortable.