Any answer is just going to be my opinion, so take it with a grain of salt. I think it depends on how sure you are that you want to pursue graduate study in the sciences. If you are positive or nearly positive, it’d be better to get as many science classes as you can now while you’re still in school, so I would say yes - change to general studies and soak up all those science classes. Conversely, if you are pretty sure that you don’t want a career in fashion anymore, then changing your major might also be a good move.
Just go in with the full knowledge that a BA in general studies isn’t the most attractive BA for employers - most employers like to see that you’ve got at least some depth in a specific field. General studies just sounds like a random collection of classes. But if you are pretty sure you are going to graduate school (or the Navy, where you’ll get some experience) then it matters a bit less.