Gray Swan, an AI security startup that helps frontier AI companies including Anthropic, OpenAI, and Google DeepMind stress-test their models before release, is overhauling its public red-teaming platform to keep it relevant for the era of AI agents.
The Pittsburgh-based company on Tuesday launched a redesigned version of its Arena, an online platform where participants compete for prize money by trying to trick AI models into violating their guardrails.
