It depends on you. Do you want to be surrounded by top caliber students and course opportunities in areas besides CS? Certainly you get people who cross admit to places like CMU or UCB or MIT or CalTech but instead choose to go to places like Pton, Harvard, Cornell, etc.
Some people value that breadth. Others want the most intense atmosphere in their field as possible. Where do you lie in that spectrum?