How bad of an idea is it to join crew as a high school junior with no prior experience?

How competitive is the club you are considering rowing with? It can be a very intense sport. Our local club (which regularly competes on national level) works out 5 days a week, sometimes twice a day. Height has a very clear correlation to speed! So at 5’ you would not get a lot of time on the water.
Becoming a cox may be an option. You need a strong, motivating personality. And although you don’t have to keep up with the athletes, you need to be at all practices.
If you’re up for it — GO FOR IT! But definitely ask about the time commitment especially in Junior Year.