And regardless of our respective personal feelings on the subject, what is very clear is that most of the highly selective colleges believe the SAT/ACT only have value when taken in context. Indeed, the highly selective colleges that have recently gone back to test required have generally tried to make it very clear they do not intend to use it simplistically, they are fully aware of the sorts of issues you raised, but have plans to use contextual information so that tests will actually help, not hurt, disadvantaged students in their process.
And some people are skeptical about that, but the bottom line is no one should assume these colleges will simply prefer A to B because A had a higher test score. Instead, they are going to treat test scores contextually, such that B’s lower test score could actually be more valuable to B than A’s higher test score is to A, depending on context. And then all of that will be folded into a much more comprehensive academic evaluation, where even more use of context will be involved.