Police forces across England and Wales have been ordered to halt the use of artificial intelligence tools in court statements and other criminal justice tasks after concerns emerged that inaccurate AI-generated content could compromise legal proceedings.
The intervention comes amid growing scrutiny of generative AI systems and their tendency to produce convincing but false information, known as 'hallucinations.' Officials say any technology used within the justice system must meet exceptionally high standards of accuracy before it can be deployed in legal processes.
