^^^What @aquapt said. Except of course, if you go to USC, I can help you through that and give you insider tips. 
I know zippo about Swarthmore so will defer to others there.
Gotta go to Eleanor Roosevelt on this one:
“No one can make you feel inferior without your consent.”
Even your family. Show them wrong wherever you go. Hugs and wish you peace in your decision!