OP, there are schools that do take the undergraduate institution you attended into consideration.
Example: https://www.jefferson.edu/university/skmc/admissions/selection-factors.html
Also, I find it highly unlikely that medical schools will give you a bump for attending Amherst or Swarthmore but not STANFORD or Columbia or Duke or Penn or Hopkins or Chicago…