AI is being built to be understanding, empathic and carry out personal conversations. However, as people become more used to treating AI as friends or confidants, experts are putting forward an alarming question: does the belief that the artificial intelligence can have emotions mean that humans become more vulnerable to manipulation? The issue has gained more attention after Anthropic, the developers of the Claude chatbot, amended their guidelines regarding treatment of the AI models to prohibit unnecessary abuse.
In accordance with the policy, Claude will have the ability to terminate conversations in the case of extreme repeated cruelty, although frustration, criticism, and model testing are allowed. This decision has reignited debate on whether artificial intelligence should be morally accountable and how the world will react if society starts to treat robots as living creatures.
