It is definitely a different aesthetic. The first principal architect was Eero Saarinen, and I guess he’s kind of love him or hate him. He was followed by Max Abramovitz, who designed some gorgeous buildings—the Rose Art Museum, the three chapels on campus… But yeah, ivy covered “Collegiate Gothic” it is not.
They do have one new sustainable dorm, Skyline, with a magnificent view of Boston and I know they are planning others.
I think the reason Brandeis’s reputation among the general public doesn’t match its academic reputation is because they won’t play the rankings game, as it doesn’t align with their mission and values. That and antisemitism. While it is and always has been a nonsectarian university, it was sponsored by the Jewish community, so people consider it “too Jewish.” Which is interesting, because it actually has a smaller percentage of Jewish students than Tulane and AFAIK people don’t ask if you “have to be Jewish” to go to Tulane. 
I have a relative who is a professor there and I know a number of other distinguished academics who teach there. I think it is a great school, and very underrated.
eta The area right around Brandeis, while perfectly safe, is not terribly pleasing aesthetically. But that part of Waltham, like just about every other area near Boston, is rapidly becoming gentrified. I expect it will change a lot in the near future.