The Verge has shared a leaked Sony PlayStation video demonstrating an AI-powered version of Aloy from Horizon Forbidden West taking part in a conversation with Sharwin Raghoebardajal, a director of software engineering at SIE.
The video, which has since been taken down under a copyright claim, featured Aloy responding to questions from Raghoebardajal and showing off a segment of gameplay, after which the character described everything that happened in the clip. OpenAI's Whisper is used for the voice-to-text, OpenAI and Llama handle the conversation and decision-making, and the facial animations come from Sony's own internal Mockingbird system.
