Well, it’s not any hotter than UCLA, UCSD, and USC! It does get pretty hot in the summer, but most students aren’t on campus then. Likewise, things get pretty lively on campus when the students are around - I wouldn’t take summer as an indication on that front. Some people don’t love Mudd’s architecture. But there are a lot of different architectural styles and some really gorgeous spaces to be found across the consortium campus.
The bigger question is whether a given student is on board for the intense core curriculum. But for an aspiring physics major, he’d probably need to cover most of those subjects anyway (whereas not all aspiring CS majors are looking for that much depth in the lab sciences, for example).