How far from home are you willing to go?
Two schools that come to mind for you are St. Olaf College in Minnesota, and Lawrence University in Wisconsin. They both have phenomenal choir and orchestra opportunities for non-majors, as well as great academic flexibility for undecided majors, and strength in all of your areas of interest. (Lawrence is particularly known for physics, and St. Olaf for math/CS, but both are solid across the board and certainly have good psych departments as well.) Both have generous financial aid, with St. Olaf meeting demonstrated need and Lawrence meeting 90-95% of need, often filling any gap with merit aid.
If your family finances are such that the financial aid you qualify for will be enough to make a school affordable, colleges like this may work well. Run the Net Price Calculators and see (every school has one of these):
https://wp.stolaf.edu/financialaid/net-price-calculator/
Of course, there are likely to be many good options for you, including SUNY and/or CUNY schools. But it’s good to know whether financial aid at private colleges like these will make them affordable.