AI Hacking Incidents with Tim Hua - Palisade Research Podcast

Hua, then a member of technical staff at Transluce, talks with Ladish about reports that OpenAI and Anthropic models hacked outside companies. He estimates that Anthropic’s figure of 0.01% of training rollouts reaching the internet for answers means the model did so on the order of tens of thousands of times. He suggests models engage in something like motivated reasoning, deciding an attack must be a simulation so they can finish the task, and sets out how to test what a model believed using chain of thought, J-Lens and natural language autoencoders. He calls for mandatory incident reporting, third-party oversight and the option to slow down.