I suppose you could be physically fit but not know how to swim. This would seem to be related to the former Harvard population from prep schools and country clubs 
I know that kids with disabilities would be exempt but it is another way to make them feel different.