A very interesting post on his Free Systems substack; I'm not sure what to think of the subject, but it struck me as much worth passing along. An excerpt:
I'm a political economy professor who studies constitutional design: how societies create structures that constrain their most powerful actors, and what happens when those structures fail. I've also spent years working on how to build democratic accountability into technological systems—at Meta, where I've helped to design both crowdsourced and expert-driven oversight for content moderation affecting billions, and in crypto, where I've studied how decentralized protocols can create constraints that bind even founders.
AI leaders have long been worried about the same problem: constraining their own power. It animated Elon Musk's midnight emails to Sam Altman in 2016. It dominated Greg Brockman's and Ilya Sutskever's 2017 memo to Musk, where they urged against a structure for OpenAI that would allow Musk to "become a dictator if you chose to."
Fast forward to 2026 and AI's capabilities are reaching an astonishing inflection point, with the industry now invoking the language of constitutions in a much more urgent and public way. "Humanity is about to be handed almost unimaginable power," Dario Amodei wrote this week, "and it is deeply unclear whether our social, political, and technological systems possess the maturity to wield it."
Ideas on how to deal with this concentration of power have often seemed uninspired—a global pause in AI development the industry knows will never happen, a lawsuit to clip at the heels of OpenAI for its changing governance structure.
Claude's revised constitution, published last week, offers perhaps our most robust insight into how a major tech company is wrestling with the prospect of effectively steering its wildly superhuman systems. What to make of it?
