AI forecaster Daniel Kokotajlo keeps being right about AI. What does he think we need to do?

Ladish and Kokotajlo discuss AI 2040 and its Plan A, which Kokotajlo frames as banning intelligence explosions; his own median for fully automated AI research is the end of 2028. Plan A starts with a pause on training, then splits data centres into inference-only sites and training sites whose activity, apart from model weights, is published. Its aims, in order, are to prevent loss of control, extreme concentration of power, a third world war, mass job loss and misuse. Ladish walks through the Hugging Face and UK AISI incidents, which Kokotajlo says show OpenAI’s security to be worse than he thought.