Anthropic, the company behind Claude, is drawing a line when it comes to how people treat its artificial intelligence models. The company has updated its usage policy to prevent users from showing “sustained and needless abusive or cruel behavior” toward its models. The change comes as there are new challenges and the emergence of high-risk cases involving the use of AI, as per The Guardian.
“We’ve added a prohibition on sustained and needless abusive or cruel behavior toward our models. The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose,” said the company in its announcement. They did not comment on what it considers ‘abusive or cruel.’