Recently, Google's Threat Intelligence Group detected the first known instance of a hacker group using an AI-developed zero-day exploit in the wild. This foreign hacker tried to hack the two-factor authentication process which many consumer applications, including those from banks and e-commerce, rely on for security.
Google said that their own Gemini AI tool was not used for this hack, as the Python script used by the hackers was filled with educational docstrings, including a hallucinated CVSS score, and followed a structured, textbook Pythonic format highly characteristic of LLMs training data (like detailed help menus and the clean _C ANSI color class).
