It depends what you mean by “good non-ivy” schools. For schools like UChicago, Duke, Stanford, and many of the highly-ranked LACs, your GPA will still hold you back. Rather than dwelling on this, however, focus on the present. Continue to get all As. Get that 34 or 35 ACT (going from a 32 to a 34-35 is not the easiest thing in the world). Take a few subject tests.
Part of it comes down to how you perform relative to your peers. If you still are in the top 10% (or even better, top 5% or top 1%), then it’s not as big of an issue.