Actually I believe you are correct. in that graduates from those schools do refer to them by there name, its just others that refer to it as an Ivy, although some grads will tend to say its an Ivy league school if they get a blank look when they say “Brown” for example.