Avon is a fantastic school and sounds like it would suit you in many ways, however they do not have crew. They do have a very competitive football team. My one son attended (coming from a NYC private too) and I’d be happy to answer any questions.
Suffield and Salisbury might also be good options that have both Football and Crew.
All 3 have a broader academic range in their student body, excellent sports and very supportive faculty.
You might also want to consider Canterbury, Kent, Hill or Blair.