If it is at all possible, visit. You are going to spend the next four years at this place. If its truly not possible, think about the differences between these schools. While their academics are both similarly strong, I get the impression that ND is a huge sports school and Middlebury is a small LAC. Very different vibes.