Taking University Physics in college without ever taking a single Physics course in my life time.

My first thought was that you won’t really be at a significant disadvantage without previous physics coursework. Then you mentioned that you barely passed calculus - now I’m worried for you. The physics concepts themselves in an introductory corse wouldn’t normally be a problem, but you may struggle with the underlying math that could result in a stressful combination. You really need a solid foundation to have a realistic probability of success. I’m not saying you can’t overcome the obstacles confronting you, but it’s likely to require a lot of time and discipline on your part.