Taking gap years for art school before attending an ivy league

Post-high-school college attendance is likely to cause you to be seen as a transfer, not frosh, applicant to many colleges. I.e. if you attend an art college after high school, you would be a transfer applicant to most other colleges. For highly selective private colleges, it is often much more difficult to be admitted as a transfer applicant than as a frosh applicant.

Unless your parents have donated a building or some such to the college, it is rather difficult to be confident in being admitted to such a college.

Note that some non-art-specific colleges do have art courses and majors, including animation courses. For example:
http://catalog.yale.edu/ycps/subjects-of-instruction/art/#coursestext