Have you checked the math course offerings and faculty rosters at UCLA and compared them to Yale to see if either matches your interests better?
Note that UCLA is on the quarter system (three 10-week quarters per academic year instead of two 15-week semesters), so you will take more courses over an academic year, but each will be “smaller”.