Does HS "competitiveness" matter?

Our son, a rising junior at West Point, still feels college is easier than high school. All of his boarding school friends say the same regardless of the (fine) colleges they attend.