I definitely don’t think there will be a red flag, as what you described is pretty normal for kids who go to rigorous schools.
Of course the important thing to keep in mind is highly selective colleges typically put a lot of work into understanding your grades in context. So if it is normal for high test kids in your school to get some B+s, then probably in some form they will know that, and they will take that into account.
I think the worry they have is more about the exact opposite sort of secondary school, where lots of kids are getting all As, particularly post-COVID. That’s the scenario in which they may be most interested in seeing a high test score too, because that may provide them with some reassurance that particular applicant’s grades were not just because of lax grading standards.