I think introductory level physics classes have a reputation for being notoriously hard, even a weed out class at some colleges. I even read on an RPI thread last year when my daughter was an appicant there, that students at RPI sometimes take physics at a nearby community college so that they can pass and make sure the notoriously difficult first year physics does not kill their GPAs and so that they can pass. (Though it would bother me as a parent if my kid had to do this to pass physics rather than take it at their own college). You are very likely capable as a student, but the course was made extra hard by the fact that you had no prior physics background even with a solid calculus background.
That being said, I am wondering if there is something out there such as “Physics for Dummies,” (not that I think you are a dummy by any means) that you could use between now and next semester to pre-study the basic concepts before you attempt the class again. Having a framework to build around may be beneficial. This is just an idea.