Your areas of interest are strengths of Trinity. If you love it, why not apply ED?
There is no reason to go to a “higher ranked” college if you prefer Trinity. It is highly ranked compared to almost all colleges in the nation, so it is not like you would be going to some so-so school. It is a great college! You will find very many bright students there and the education is top notch. Its vibe may not work for some who prefer other small liberal arts colleges with very different vibes (the ones you mentioned- Bowdoin and Bates- have no fraternities, for instance), but all that matters is what works for YOU.
And there are very many types of students at every college, not just the prevailing stereotype. For instance, the person I know best who went to Trinity does not fit the stereotypes at all— and she loved it so much that she is hoping her own daughter will go there.