Not directly. What will hurt is a limited course selection and limited research opportunities. Consider applying to REUs - they prefer students from colleges without research opportunities, which includes community colleges.
Can you expand on your journey for junior and senior year? Where do you intend to transfer to?