The “pretentiousness/cliqueyness” is no concern. You will find your people at Georgetown, or any school.
However, your main concern is valid. It really doesn’t sound like you want your life to go in that direction. It is hard to get in to an awesome university like Georgetown and then to rationalize not attending. However, you have every right to be happy.