You need to do what you must to be able to study something you have an interest in. Yes, the B.A. is not as rigorous as the B.S. and that might hurt you a bit but if you take all the important chemistry courses and get some extensive laboratory experience doing research or a summer internship, this will mitigate the situation a bit.