As a pre-med student (going by your thread title), you are in an excellent choice school to be prepared for med school admissions. F&M has fantastic pre-med support and the student acceptance rate to med school is pretty high. I’d say if you are doing as well as you say you are in your biochem major and you follow what your pre-med advisor recommends, then your shot at med school would be excellent coming from F&M. I don’t think a more “prestigious pedigree” school will make that much of a difference, as F&M is well known in the med school circles.
However, if you truly dislike the school and can’t see yourself being there for 3 more years then best of luck moving on. I also agree - rethink Amherst if you don’t like small LACs.
Info for F&M pre-med support: Pre-Medical