I think this happened to me a couple of times over the years:
Someone: “You went to Boston College, right?”
Me: “No, Boston University.” 
I don’t expect everyone to know the difference. I still learn things about colleges all the time. Was looking into college visits and just discovered what someone else mentioned above about Hamilton being in Clinton and Colgate being in Hamilton.