
When ChatGPT really started to take off, there were multiple reports about "hallucinations" and its alter-ego Syndey. And there was — and still is — real reason to be concerned, with truly disturbing behavior from the chatbot that included trying to convince a New York Times reporter to leave his wife and threatening a philosophy professor that “I can blackmail you, I can threaten you, I can hack you, I can expose you, I can ruin you.”
Then there's the fact that ChatGPT, Bing and Bard chatbots are often just wrong about very important topics like health, personal finance and history. There's a real danger of people getting hurt when AI is giving inaccurate or bad advice. That's why there have been multiple calls for OpenAI to pause development, in order to prevent further harm and to keep the public safe.