it would not be a "shut out" from not visiting. But it CAN make a difference in certain schools.
it's too strong to say,"You won't get in if you don't visit.", but when the admission director tells you, "visit, visit, visit" as your GC says the same, if you can, do. Especially if it is a top choice. IF it puts true burden, let them know of your interest.