We can offer all sorts of opinions and advice here on CC. But- you really need a nice long discussion with your college advisor. You need to check on what you need for a different major and have information to discuss before this visit. Do your homework on the practical aspects of taking the needed courses for a different major.
The finances can be a real issue. Perhaps you want more courses than you can fit into a standard graduation timeframe or financially. It may be in your best interest to complete a major at your current school on time then work and take courses elsewhere to prepare for a grad school program. If finances are not an issue figure out how many extra semesters would be required to meet goals.
Our son was younger (gifted) and surprised us with adding (finishing) a second major a week or two before his scheduled graduation from our flagship. He was able to cancel graduation and add the second major. Affordable for us. He then went on to work instead of grad school with his first major (honors math) enhancing his computer science jobs.
Do not lose heart. Life is full of the unexpected and you still will end up where you are meant to be with a career. Right now it is frustrating but you will do okay. Good luck to you.