Is there a reason you think W&M may be better for you?
Can you stick with your clubs and see if acquaintances turn into friendships? And do class sizes get smaller as you delve into your major – if so that may be a way to develop relationships.
IMO transferring is not easy on one’s social life. You will be walking into a situation where others have established friend groups, know the routine of the school, etc.