It doesn’t sound bad. It sounds uninformed. All college ranking systems are flawed. They don’t measure what many think they measure…ultimate career success. At best they’re a proxy for their graduate programs. In some instances, highly ranked programs are known to offer a poor undergraduate experience.
When I say your success is based on what you do and not the school you go to, I mean that very seriously. As an example, look at where the directors of all NASA facilities, including JPL, went to undergrad. All but one went to state school, most of them random places. The one exception is RPI. If it was about the school and how the school is ranked, they all would have attended highly ranked programs. They didn’t.
UMD is a very good school and a known commodity to you. In making this move, there is a reasonable chance that you will be less happy where you land. Careful what you wish for.