What state are you from?
We live in the Northeast of the US, and did look at several very highly ranked LACs in this geographical area. My daughter ended up at a small university in eastern Canada (the Canadian equivalent of a LAC). It is my impression that the culture is quite a bit different, although the academics would have been very good either way. I am not very good at describing culture, but it seems to me that there is a difference between “smart with serious academics” versus “prestigious”, and where she is has the first, whereas the highly ranked LACs that we looked at have both.
I do agree that the culture at highly ranked LACs is not a good fit for everyone, even if the academics are excellent. Also, it is very difficult while you are still a high school student to know what is going to be a good fit for you.
When I was in graduate school (at a highly ranked school) there were indeed other students there who had done their undergrad at a very wide range of other schools, including many state flagships. The trick is to do very well wherever you are or wherever you end up.
I don’t think that this is an easy decision. There is still time to apply as a transfer student to other schools.