You don’t need a minor. You say you feel penalized because you can’t look around and explore a bit class -wise, but you did that already for the first three years. Colleges are concerned about perennial students and want to make sure you get out of there with a degree.