To be recruited by Harvard, you would need national ranking at this point, i.e., exposure at national level camps and discussions already with coaches. If you are not there, it won’t make a bit of difference if you leave Bball for other ECs. Follow your passions.