It is your FIRST DAY. You aren’t going to have friends like you had at home, most of whom you have likely known for years. You are definitely overreacting. Trust me that not everyone on your campus is into sports (I went to a big sports school, and definitely knew people who weren’t interested in football games or basketball).
The right thing to do is to keep yourself busy. Get your books and find your classes. If someone invites you to dinner or to go to a campus event, go (or invite people on your hall that you think look friendly). Look for activities or clubs to join where you might meet people. Strike up conversations with people in classes – exchange contact info so you can get help on assignments or with questions. If you have spare time, get a part time job (often a good way to meet people). Put the thought of transferring completely out of your mind for now.
When you go home for winter break, after you have grades and a semester under your belt, you can think then about whether you should transfer. But for now, explore your campus, try to make friends, and do your best in your classes.