I would recommend taking physics. Not because the class helped me learn a lot, but because it really helped me think about different ways to resolve problems. I hated the class, but I am definitely a better student for it. Chemistry does not help you at all in physics. However, I believe that it is important that you take it. For me, physics was significantly harder than chemistry ever was.