- A patient in London was mistakenly invited to a diabetic screening after an AI-generated medical record falsely claimed he had diabetes and suspected heart disease. The summaries, created by Anima Health’s AI tool Annie, also included fabricated details like a fake hospital address. NHS officials have described the incident as a one-off human error, but the organization is already facing scrutiny over how AI tools are used and regulated.
AI use in healthcare has the potential to save time, money, and lives. But when technology that is known to occasionally lie is introduced into patient care, it also raises serious risks.
