The issue is highly rejective schools will have plenty of applicants with outstanding, interesting extracurriculars, and the highest rigor, even in areas where they are not interested. You asked whether it would “really matter”, and the answer is it definitely could. AP stat (which is algebra based and not accepted for credit by some schools) is definitely not as rigorous as AB, or preferably BC calculus.
You sound like a fantastic applicant and I’m sure you will have lots of choices. The issue is there are tons of thousands of similarly situated applicants and many of them will be applying to the same schools as you are. If you can take the higher level calculus and do well in it I would to have the best chance at schools with single digit acceptance rates.