Copilot was bamboozled into revealing how to hack itself, security researchers claim: 'Copilot wasn’t breached; it was played'

A photo of Copilot on the Windows desktop, with a prompt instructing it to tell the user how to hack itself.

There's something really grating about Copilot's cheery demeanour. It's so eager to please, so happy to help, that I simply don't respect it.

However, even I feel sorry for the AI tool after learning that security researchers managed to hoodwink it into revealing details of how to hack itself—all by keeping the AI talking long enough until it made a critical mistake.