As I was reading this thread, my impression is that neither option is best for you as the negatives–real or not–are substantial to you. My thought was that you might be better served by attending an LAC. I then researched your earlier threads & saw that you made one asking whether Pomona or Williams should be your choice.
In short, focus on your outstanding LAC options of Pomona or Williams since the negatives that you see in Brown & the Columbia/Trinity options are overwhelming your thoughts about each alternative.