How much does it hurt my chances of admission if I have only taken AP exams and not SAT II exams?

It depends. How many APs did you take? Did you get 4+ on most/all? If you have a good mix of humanities/STEM classes, you should be fine without SATIIs. They just help verify your success in classes, and give an extra data point about strengths/weaknesses.