The course rigor metric is a continuum, but once you get above 8 or so APs over your HS career, it’s a very flat curve, IMO. Will it make “a difference”? Probably. Will it be meaningful? Probably not.
And that’s at the schools with the most competitive application pools. At schools where the average student takes 2-3 APs, the difference between 6 and 7, or 10 and 11, is essentially zero.
I assume that if you’re taking 5 Junior year, you’ll be well over the “that’s plenty” hurdle at even the top schools. Dropping from APUSH to Honors is exactly what my older daughter did and she just graduated from a T10 engineering school, so it worked out fine. I suspect it will for you too.
And fwiw, my younger D22 passed on AP Lit this year, so she’ll end up with 12 instead of 13 APs. I have zero concern over it.