I agree that you’ll absolutely hate Engineering if you hate Physics and Math @JulianIsHere.
I thought all schools required at least Calc for CS, but I just found one that doesn’t. They strongly recommend Calc through Multivariate, a course in Proofs, and one or more of (1)Linear Algebra With Differential Equations, (2)Mathematical Modeling, and (3)Applied Statistics.
It doesn’t look like any of those are required for the BA or BS, though. Physics isn’t required either.
It’s Denison in Ohio. Here’s the link:
http://denison.edu/academics/computer-science/degree-requirements
I think you could put together a program at the right school that would allow you to take what you like and avoid what you don’t, assuming you do CS. Forget Computer Engineering. They’ll kill you with Math and Physics everywhere. Just be really careful about which program you choose. I know people who never finished their degree because there were one or two courses they couldn’t get through with a passing grade.