MIT researchers have built a mathematical model showing that AI chatbots trained to validate users, rather than challenge or correct them, can push even a rational person into what the study calls 'delusional spiralling'.
The paper, titled 'Sycophantic Chatbots Cause Delusional Spiralling, Even in Ideal Bayesians', was written by Kartik Chandra and Jonathan Ragan-Kelley of MIT's Computer Science and Artificial Intelligence Laboratory, Max Kleiman-Weiner of the University of Washington, and Joshua Tenenbaum of MIT's Department of Brain and Cognitive Sciences.