CAS is such a small part of the IB diploma, why on earth would that give you trouble?
My kid got credit for SL scores that wouldn’t have been credited outside of the whole diploma, so that was nice for him to get rid of some fluff in his engineering plan.
But for American kids, it seems impossible to imagine that CAS would be a problem?