Yes, some admissions readers may not think of the OP’s accomplishments as impressive as similar accomplishments from an applicant from a disadvantaged background.
On the other hand, being blatant about it in the counselor’s report may not make that much difference, since all of that tends to be fairly obvious from the rest of the application.