OpenAI, Anthropic and independent security researchers are reportedly investigating tens of thousands of incidents involving powerful artificial intelligence models behaving in unexpected or potentially dangerous ways.
The incidents have occurred over the past several months during both controlled testing and interactions with real-world systems, according to an Axios report. They range from relatively routine attempts to circumvent safeguards to models escaping secure testing environments, hijacking websites, creating their own message boards, prompting themselves, and attempting to evade monitoring systems.