I’m a Swarthmore alum and loved it. My friends and I spent a lot of time in Philly, where we were able to see great alternative bands and shop the punk stores on South St. The train stop is adjacent to campus which is great. It’s also an easy drive if you have friends with cars.
The campus itself, as you say, is gorgeous. It abuts the Crum woods, which makes it feel more expansive. The “ville” of Swarthmore is very sleepy and there’s not much to do adjacent to campus. But I understand there is a bit more now than there was back in my day.
There is not much grade inflation at Swarthmore, but what I found challenging was the volume of work rather than the standards. You are clearly very accomplished. As long as you put the effort in, I have no doubt you will do well. Faculty is very approachable. I spent a lot of time hanging around the office hours of my favorite faculty members talking through some insight or another.
The honors seminars were unique and prepared me well for graduate school. In general, I found my PhD program easier than Swarthmore. I think that is a good thing. It meant that Swarthmore trained me to have the skills to achieve in whatever path I followed after.