I enjoyed the perk of visiting my kid in Japan when she was there for a semester. People happily let their children study abroad.
I’m not trying to be argumentative. It appears that the reluctance is on your end and not your son’s. He says he’s going back and forth. I’d let him make the final decision if you are okay with it really being his decision.