Colleges don’t see middle school grades so from that standpoint you are fine. But 1) most people cannot flip a switch and turn from a mediocre middle school student into an outstanding high school student 2) if you are not tracked into the higher level HS classes based on your performance in middle school that could be an issue.