I’d say you check all the boxes for all top boarding schools. If you are certain you want to continue with swimming, you should consider Lawrenceville for its strong academics and swim program. It is similar size to Choate, but has an arguably better location, if shopping/proximity to a metropolis is important to you.
And yes, definitely reach out to swim coaches with your records. Good luck!