Why isn't prestige taken into account?

“Ask a doctor from a prestigious hospital in a specialized field where he/she went to school, it’s likely you’ll end up with the same answers over and over.”

I just looked at the last 6 specialists that I visited (as a patient) at two very well ranked medical facilities in the Boston area. I did not see the same university twice, and I only found one Ivy League school. I did find some very good universities (McGill, Cornell, Tufts, UVA, John Hopkins), but other than one doctor doing both undergrad and medical school at the same university, I didn’t see any repeats at all. One of the specialists that I have seen recently told me (we were chatting about undergraduate schools) that the MD students where he studied had come from a very wide range of undergraduate schools – the same thing that I noticed when I was in graduate school in an entirely different field.