The potential for reaching the singularity (which we’ve discussed in a few places, such as here) is the reason we can’t pretend everything’s going to be OK. Our son has been at the Cyber table with both Anthropic and OpenAI for some time as the military probes the DEFCON level of the latest AI developments. He is leaving the military in December, and both of these companies have come after him with crazy offers, a hard no to both irresponsible organizations.
OpenAI published a paper in
expectation that AI superintelligence will profoundly reshape the world, the company released a 13-page industrial policy memo of its own ideas to tackle the coming transition.
We discussed it a bit here, but make no mistake, these companies have unleashed on the world, our enemies included, technology they admit they cannot control. The recklessness is breathtaking. I’ve been accused in other places on this board of being too nonchalant about the problem of students cheating with AI. That problem is solvable, the singularity is not.