Fraternity and Honors College at the college of Charleston

Hey everyone. Question for people at the college of Charleston currently, more geared towards guys in fraternities, are there any negatives/things to think about if I wanted to be in the honors college and join a social frat at cofc besides managing my time? For example, is the honors college looked down upon in any sense by fraternities? Any advice welcome.