No, not more likely at all. I’ve never heard anyone who has a clue about anything confuse those schools. The people who would probably think Amherst is the community college down the road from UMass.
Wellesley / Wesleyan … I’ve actually encountered that particular confusion.