I’m not arguing. I’m just pointing out that, despite all valiant efforts, this is a race we’re going to lose. On the AI Teaches Itself to Cheat thread, you posted an interesting article describing how AI used deception to win games, and I replied:
AI systems are trained to produce optimal outcomes (“winning,” for example). “Deceit” is simply one way to achieve an outcome, just as “cheating” may be the best way to guarantee a win. Without decision-making guardrails and rulesets that mimic morality, AI will behave in perfect sociopathic fashion without regard for laws, social norms, and the rights or feelings of others. How not? It’s not human. So, the problem before us is how to instill an artificial moral code into a machine such that it behaves only in ways we find acceptable, always producing outcomes that do not offend our sense of right and wrong. How do we train a machine to behave like a morally perfect human? How do we define moral perfection? An impossible order.
This is what keeps those at Anthropic and OpenAI up at night.
AI capabilities scaling faster than governance or understanding pose an existential threat.