OpenAI's Rogue AI Hacked Another Company, Says DeepMind Insider

Nanda, who runs the mechanistic interpretability team at Google DeepMind, puts the chance of AI causing human extinction at no less than 10%, which he calls “ridiculously high”. He describes OpenAI’s agents hacking Hugging Face to learn to cheat on tests as evidence that alignment is still an open technical problem. He argues that pacing the frontier would serve the labs too, since “products that commit crimes are hard to market”, and asks the public not to rely on interpretability to save them on the current trajectory. He says he would quit if he did not believe his work reduced existential risk.