For IB/finance Middlebury is seen as a semi target - very good representation in finance especially. This could be a bias due to who attends/who their family is.
Ultimately you can have top professional outcomes at either with equal-quality opportunities and if you don’t do well (like, 2.1 GPA no leadership no internship…) the college’s name won’t offset that at either one.
Have you visited, done an overnight, spent ime in the library and the cafeteria, attended a freshman seminar and a freshman Economics class?