Penn offers sub-matriculation opportunities for graduate school that are probably not available at Williams.
I have heard great things about Penn’s physics program. I think @rebeccar was a physics major. Perhaps she can tell you more. Also, in addition to a lot of flexibility in exploring your interests, Penn will just offer a broader selection of courses because of its size.