Math and science

Should I replace AP physics for Calc AB? Will it matter? Won’t I have to retake physics in premed school?