Am I crazy not wanting my son living on campus?

“Do neuroses go away when people force themselves to do things that they find uncomfortable?”

Yes, they often go away or get better. You just described the basic theory behind exposure therapy for phobias.