My brother in law is gay and describes himself in almost exactly the same terms as you. And he’s 50. He’s led a sad and closeted life - although he now has a partner with whom he is happy and is slowly coming to terms with himself and his sexuality.
I understand it’s the “I don’t want to be a part of that club” that makes you say the “rude” things you said. And that message obviously comes from your family and others around you. I get it. I love my brother in law very much but he has the exact same attitude. Hopefully, you won’t feel the need to lead the same sad and shameful life he has and will grow and mature into a man who is comfortable with his sexuality and with others in the LGBT community.
Live in the dorm you need to live in. If you’re not ready to come out, you’re not. There’s nothing wrong with not living in an LGBT dorm - I don’t think you’d be happy there. But I do hope that you come to terms with yourself and your family soon.