Like @hanna says rich people sent their kids to elite colleges so they can be around there peers and they can easily afford it.
and for the extremely wealthy or famous private elite universities are much more adept at handling the security requirements then large public universities.