What are the finances for each choice? Would you need to take on any debt at either school?
Students are going to be largely focused on academics at Vassar also. That is part of attending a highly ranked school.
Highly ranked universities also have a lot of students who are focused almost entirely on either (i) Doing really well in their classes and/or (ii) Doing better than you in their classes. Some people might describe some aspects of this as “toxic”.