Jacob Coxon, a researcher who has worked on pre-training at Anthropic and OpenAI, has publicly quit while raising a stark warning about the future of artificial intelligence. Coxon says leading AI companies are racing toward self-improving superintelligence without having a reliable plan to keep increasingly powerful systems under human control. His warning has also been backed by other Anthropic researchers, including team lead Evan Hubinger, who said he personally believes there is a greater than 10% chance AI could kill all humans within the next decade.
