The OpenAI and Anthropic incidents last month — and more recently, Meta — showed why AI labs shouldn’t be allowed to grade their own homework. We know about the hacking failures only because the companies involved chose to tell us.
The public currently has no way to know what it isn’t being told; if either company had chosen not to tell the public, there is no independent institution that would have discovered these incidents, confirmed what happened, or required that they be disclosed. That’s an extraordinary amount of trust to place in companies racing to build the world’s most powerful AI systems.
