Yes, I am not inclined to chose a school because of the sports scene at a given school. For me its going to be the quality of education, access to research opportunities, approachability to faculty and company of peers in the same field etc.
Thanks for the insight though.