Wesleyan definitely has great jazz faculty and an atmosphere conducive to collaboration.
Hamilton has one really amazing jazz prof, Doc Woods, but the school is super small and he told my jazz guitarist son that he would have to travel to Syracuse to get the level of play he was looking for. He gave my son an amazing two hour lesson when we visited.
Our son ended up deciding to go the BM route with a double major in Math at USC. USC has great jazz/blues/rock/world music profs and they offer a BA in Jazz Studies which allows quite a bit of flexibility to take courses outside of music.