If you can’t keep up the academics along with athletics, you won’t do well at an Ivy. You want the benefits of being an athletic recruit but you don’t want to do the work for both.
If you give up soccer and only concentrate on academics, then your chances of an Ivy or other elite go down. It’s a fact that athletics really helps with admissions.
I, personally, don’t think your academics will improve when you give up athletics. Athletics keeps you organized and focused. If you had 20 extra hours per week, would you take 4 more AP classes or get an A+ in a class you otherwise would only get an A? And would it matter? The advice usually given on CC is if a student drops an EC, another EC should be added - band, art, working on the school paper.