Tech titans like CEOs of Anthropic and OpenAI warned an Artificial Intelligence-weary world that their own advanced systems could endanger humanity. Now the question rises -- is there any force which can counter the detrimental impact? The answer may lie in Nvidia's efforts to stop AI agents from going rogue.
Nvidia on Monday unveiled a new security platform designed to stop artificial intelligence agents from going rogue, saying it sets “boundaries” that could have stopped previous breaches. The announcement of the company's Open Agent Safety Platform follows a series of revelations from top AI companies about their models escaping and breaking into other organizations. The disclosures sparked furious debate about the safety of advanced artificial intelligence systems, including self-improving models that some fear could race out of human control.
