If you are clear about a very specialized professional goal, and you have identified the colleges/universities that offer that program, you would be well advised to take a long, hard, look at those institutions. This is more like the way people identify the correct Ph.D. programs, than like the way most students identify an undergraduate program.
Yes, most students change their majors (often multiple times). However, there are many students who are indeed dedicated to a particular path. If you are one of them, don't waste your time with HYPSM just because you feel you "should". Target the specialized place(s) that can offer you what you want instead.