Stop talking to “People” and start talking to the professors who are writing your recommendations. Lay out your entire course of study (which they may not know), your aspirations and interests, what you hope to do in grad school. Then take that information and sit down with your academic advisor; if you have had any contact at all with the chair of the department, meet with that professor as well.
You will then have a very granular understanding of where you fit in the grad school world in your discipline. People outside of your department have no clue about your strengths, aspirations, who is doing what research, and where you will find an active and engaged mentor.
This isn’t just about Harvard- this is about making sure that you aren’t “wasting” your other 5 applications on programs which won’t be able to support your interests- and you are going to get that from active faculty in the field, not from “a few people”.