OpenAI and Anthropic agree: AI safety and "alignment" concerns have been brewing for a long time, but they reached a fever pitch last week as several Anthropic employees' tweets went viral. "I resigned from Anthropic today," wrote Jacob Coxon. "I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives."
"Do not underestimate the power of this technology," he added. "These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing."
