One data point that can sometimes be helpful when comparing programs at similarly sized schools is number of students in a given major. For example, one might believe students gravitate towards the strongest depts at a given college, or that higher numbers represent proportionately more opportunities to learn from or network with other students in a given field.
The CDS might obfuscate in this case by combining different fields into “physical sciences,” but other sources from the college sites suggest about 5x more (pure) chemistry majors at Carleton (which has about a 10% larger student body). It looks like about 38 vs 8. Both links sample over only one year, however.
That said, these are both amazing schools and I think a student could get a fantastic chemistry education at either.