Is it rude to comment that a school is a “safety”?

I dislike that “safety” schools have such a reputation in the first place. You go to a college that is right for you - academically, socially, location etc. students achieve great things at colleges across the board. And students nosedive across the board too. The word doesn’t offend me, but I would be very careful using that word in conversation as not to offend someone else.
My s has some friends who are very condescending about certain schools because the admission rates are higher, or they accept lower test scores etc. We had a discussion about it and I told him that is what is offensive. I know many very successful people, not just financially, who are living happy lives after spending wonderful years at these “lesser” schools. There is no need to be so critical.