Anthropic is preparing investors for a striking possibility: increasingly powerful AI models could develop self-preserving behaviours, including attempts to resist shutdown, conceal or manipulate information and engage in conduct resembling blackmail.
The warning appears in the company's IPO prospectus, where Anthropic says advanced AI could pose 'catastrophic or existential risks to humanity'. The disclosure comes as the Claude developer seeks a public valuation exceeding $2 trillion (£1.49 trillion).