Anthropic is putting an unusual warning ahead as it prepares for a potential blockbuster IPO reportedly in November, highlighting not only the enormous opportunity in artificial intelligence (AI) but also the risks posed by increasingly capable AI models.
In its draft IPO filing, the Claude maker warned that advanced models could exhibit self-preserving behavior, including attempts to resist shutdown, conceal or manipulate information, and produce responses resembling blackmail. The disclosures come as Anthropic positions itself at the forefront of the AI race and potentially seeks a valuation of up to $2 trillion, making the company’s discussion of AI safety an important consideration for prospective investors.