Here’s the thing.
I’m hoping that your therapist is the one of the very few people in the world with whom you’re totally honest, even when it hurts. In whom you have complete trust.
He has acknowledged that his advise won’t be easy. That doesn’t make it bad advise. It just means that he’s trusting you as a young adult to do the tough thing when it’s the right thing to do.
Trust his advice.