
Just last week, I reported on ChatGPT falling for the "dead grandma" scam. Multiple users leveraged the technique to trick the sophisticated AI-powered chatbot into generating Windows 7 activation keys.
The users guilt-tripped the chatbot with the aim of making it sympathetic, potentially loosening its grip on its regulation and guardrails. While ChatGPT generated the requested activation keys as part of a lullaby, multiple users indicated that they were useless.