<p>You seem really set on Middlebury. I think you should go for it!
I had a similar issue, where I was choosing between some top Ivies and Amherst. Ultimately, I went with they place I loved, rather than the big name. I have not regretted it since.</p>