Dr. Donald Macfarlane presents a grave scenario that creates a pressing ethical and practical dilemma that will lead to malpractice suits, inflated reimbursements and compromised patient care. He argues that there are limitations in utilizing artificial intelligence-driven generative pre-trained transformer tools, such as OpenAI GPT 4 or Google's Bard, in critical domains like clinical note creation, billing, X-ray reports, discharge summaries or insurance submissions due to the risk of creating facts, which are misleading, inaccurate and fraudulent.
Generative AI (Gen AI) has gained recognition for its capability to formulate convincing and well-written documents from specific prompts. This leads to the use of these tools in customer service and creative writing. However, there are increasing concerns over "hallucinations" or the propensity of GPT to invent facts and argue that they're true. This concern creates practical and ethical impediments to using the documents produced by generative AI tools in medical note-taking and billing documents.
