Does not taking physics in HS look bad?

Summer (high school or college) courses and their grades will have to be reported on college applications, so colleges will see that you are taking calculus twice.