Will going to private school effect my chances of attending an Ivy League or other elite University?

Probably many Harvard students and alumni are/were not math or related majors or came in advanced and interested enough in math to have come anywhere close to even noticing the third honors level math course that is Math 55a and 55b.