Should I drop a college honors course? Would it look bad?

@rymose: Are you willing to share the course name or title ?

Is it unusual for a male to take this course ?

(I ask because I was in a similar situation in a high school literature class & the teacher hated that I was in this class.)