Direct Entry into nursing spots are competitive for a reason. Their cohort numbers are capped without flexibility due to clinical space needed as you move through the program.
With nursing you are stuck and you will lose time every time you transfer. Staying where you are at will be the quickest way to complete your degree.
You could try a community College for your ADN but again, space will be competitive and you may not get into the nursing program in your first time.
Have you reached out to the counseling centers on campus? What makes you feel like you are at the wrong college now?