Anthropic has accused groups linked to Alibaba and its Qwen AI lab of carrying out a massive campaign to extract capabilities from Claude just by asking it a lot of questions, as first reported by Reuters. The AI developer wrote a letter to U.S. lawmakers alleging that Alibaba used nearly 25,000 fraudulent accounts to generate more than 28.8 million interactions and glean detailed, proprietary information about Claude.
Alibaba has not publicly responded to the allegations, and there has been no independent confirmation of Anthropic's claims, but simply leveling them has potentially enormous consequences. The sheer volume of accounts and interactions is eye-catching, but it's even more fascinating how it reveals a vulnerability in AI models that can give away their secrets.
