Anthropic, a leading AI company, recently refused to sign a Pentagon contract that would allow the United States military “unrestricted access” to its technology for “all lawful purposes.” To sign, Anthropic CEO Dario Amodei required two clear exceptions: no mass surveillance of Americans and no fully autonomous weapons without human oversight.
The very next day, the U.S. and Israel launched a large-scale offensive against Iran.
This leaves many wondering: how different would a war with fully autonomous weapons look? How important an ethical decision was it, when Amodei referred to fully autonomous weapons and mass surveillance as AI “red lines” that his company would not cross? What do these red lines mean for other nations?