Sony Explores AI Integration with PlayStation Characters
According to an internal video leaked to The Verge, Sony appears to be advancing its integration of artificial intelligence (AI) into gaming by developing AI-powered versions of its PlayStation characters.

The leaked demonstration video showcases a prototype where Aloy, the protagonist from “Horizon Forbidden West,” engages in real-time conversations with players using voice prompts during gameplay.
This prototype leverages several advanced technologies: OpenAI’s Whisper for speech-to-text conversion, GPT-4 and Llama 3 for conversational responses and decision-making, Sony’s Emotional Voice Synthesis (EVS) for speech generation, and Mockingbird technology for facial animations.
While the demo was conducted on a PC, Sony has also tested components of this technology on PlayStation 5 consoles, noting minimal performance impact.
This initiative aligns with a broader industry trend of incorporating AI to enhance gaming experiences. Nvidia, for instance, has developed ACE (Avatar Cloud Engine), enabling AI-powered non-playable characters (NPCs) to engage in natural language interactions with players.
Similarly, Microsoft has partnered with Inworld AI to explore the integration of AI-driven characters and storylines into Xbox games. Additionally, Microsoft’s Muse AI model generates gameplay scenarios, assisting developers in prototyping and ideation phases. Muse, however, currently produces visual mockups rather than fully playable simulations.

At the same time, the integration of AI into game development raises important considerations. There are concerns about the potential impact on employment within the industry, particularly for roles traditionally involved in tasks now automated by AI.
A survey conducted during the 2024 Game Developers Conference revealed that 49% of respondents reported the use of generative AI tools in their workplaces, with 31% personally utilizing them.
Want to see more of our stories on Google?
P.S. Want to keep this site truly independent? Support us by buying us a beer, treating us to a coffee, or shopping through Amazon here. Links in this post are affiliate links, so we earn a tiny commission at no charge to you. Thanks for supporting independent Canadian media!