Best way is to talk to current students, after that read student reviews on Niche, Fiske and Princeton Review Guides, and the book Hidden Ivies.
I agree that there will be a range of students at all the QB LACs. IMO Swat and Williams (among QB partners) have the most intense academic cultures that can feel ‘grindy’, with a not insignificant proportion of students who go beyond being competitive with themselves.