I understand how you feel. I have just seen too many examples when ivy-types get the benefit of the doubt. I have seen how people assume that their opinion has more meaning, is more thoughtful. Finally, I have seen Penn-types flounder till they are 35 years old, still able to get one more big job opportunity because they are in an esteemed group. Embarrassingly, I have even made that hiring mistake, myself, as a senior leader.
OP absolutely loves both schools. As I said, if it is close decision and there is no financial issue - tie goes to the ivy.