Scientists have found a simple maths formula that can indicate when an AI system is about to go rogue.
The discovery allows researchers to see a signal that indicates when a system is about to stop giving appropriate responses and switch to dangerous ones. It could help the makers of AI systems to stop them from giving answers that encourage self-harm, financial loss or extremist ideas, according to the two physicists who found it.
