In the fast-evolving world of technology, Sony is keenly exploring the integration of AI within its PlayStation brand. The company’s focus is twofold: enhancing visuals and performance for PlayStation 5 Pro users—an upgrade that justifies its €700 price tag—while also experimenting with AI-driven non-player characters (NPCs) in gaming, which is proving to be a less-than-ideal endeavor.
A recent video leak, initially reported by The Verge, showcased Sony’s attempt to implement generative AI in a prototype featuring Aloy from Horizon: Forbidden West. In this demo, Sony’s director of software engineering, Sharwin Raghoebardajal, engaged in conversation with a digital version of Aloy responding to voice prompts. The AI’s attempt at dialogue lacked the charm of the original voice actor Ashley Burch, resulting instead in unnervingly robotic exchanges accompanied by exaggerated mouth movements.
During the conversation, the AI version of Aloy revealed key plot points from the first game, providing answers with an awkward pause before responding. Utilizing AI vision capabilities, it discussed various aspects of the game world around them, including the time of day.
“It’s the afternoon, and it’s quite hot under the sun,” the AI Aloy stated, showcasing the discrepancy between the natural flow of human interaction and AI response times.
The voice of fake-Aloy was generated using OpenAI’s Whisper model for speech combined with Llama 3 from Meta and OpenAI’s GPT-4 large language model. The facial animations were crafted using Sony’s own Mockingbird suite, a specialized model not widely accessible. All of this technology was integrated into the Decima engine, the framework used for both Horizon titles by Guerrilla Games.
Does Sony Think Gamers Want AI-Powered Aloy?
Raghoebardajal suggested this trial was “a glimpse of what’s possible,” but the demo failed to leave a lasting impression. According to The Verge, the original video was promptly removed by an entity linked to Sony, although alternative versions exist on platforms like Reddit. This concept is not new; companies like Nvidia have been delving into AI NPCs for over a year, demonstrating various forms of AI interaction in gaming.
The race among major gaming corporations to weave AI into their new offerings is intensifying, irrespective of player demand. In a February blog post, Microsoft unveiled their generative AI model named Muse, aimed at aiding “gameplay ideation.” This tool reportedly generated a hero shooter similar to Overwatch—raising questions about AI’s capacity to innovate and improve upon existing game designs.
AI is often criticized for being derivative; its functionality in creative mediums is essentially a remix of existing works. Although AI-driven Aloy represents a minor experimental project for Sony, it reflects broader industry challenges. Publishers are increasingly vocal about considering AI replication of artists’ voices to reduce production costs. The gaming community can often distinguish between professional performance and machine-generated content, underscoring the importance of authenticity in gaming experiences.
Future AI Upscaling Enhancements for PlayStation 5 Pro
Mark Cerny, the lead architect of the PlayStation 5, shared insights with Digital Foundry regarding upcoming improvements to the AI upscaling capabilities of the PS5 Pro. The company plans to integrate AMD’s innovative FidelityFX Super Resolution technology into PlayStation 5 games that currently support PlayStation Super Resolution (PSSR). Cerny anticipates that FSR 4 functionalities could launch for the €700 console by 2026, marking a significant advancement for performance enhancement.
This initiative is part of the recently introduced “Project Amethyst” in collaboration with AMD, aiming to optimize around 30 titles supporting FSR 4 at launch, including popular titles like Marvel’s Spider-Man 2. Cerny emphasized the intention to merge PSSR with existing PS5 Pro games before extending FSR 4 to the original PS5. Historically, FSR was hardware-agnostic, but the RDNA 4 GPU architecture has changed that requirement, limiting FSR 4 use to the latest graphics cards like the Radeon RX 9070 and RX 9070 XT.
With advancements in both AMD’s graphics technology and Sony’s robust PS5 GPU, the integration of machine learning capabilities into the PlayStation ecosystem will require significant development effort. However, Cerny stated that some elements of FSR 4 have already been integrated into the PS5 Pro, which can achieve 300 8-bit TOPS (trillions of operations per second) akin to the latest AMD GPUs. FSR 4 is set to enhance PlayStation’s upscaling capabilities substantially.
AI upscaling enhances lower-resolution frames through sophisticated algorithms, allowing for visually appealing higher-resolution outputs without compromising performance. During preliminary tests, FSR 4 exhibited impressive performance improvements and sharper visuals compared to its predecessor, FSR 3.1. Sony’s PSSR technologies are expected to support all games labeled “enhanced” on PS5 Pro, with some titles like Call of Duty: Black Ops 6 exhibiting frame rates upwards of 80 to 100 FPS, a marked improvement over the standard PS5.
The landscape of gaming on PCs is increasingly benefiting from AI upscaling techniques from various developers, including Intel, AMD, and Nvidia. While the PS5 Pro offers improved performance over its predecessor, players will encounter fewer graphical options than found on PC. FSR integration will be seamless, enhancing gameplay universally without players needing to engage with the technology themselves, although they may notice improved frame rates and visual fidelity.
While there is ongoing debate among gaming purists about the implications of AI upscaling and generated frames from technologies like FSR and DLSS, enhanced hardware can significantly benefit accessibility in gaming. If Sony channels its AI investments toward facilitating more immersive, high-fidelity gaming experiences, that focus could drive the industry forward in a positive manner.
FAQs About AI in Gaming and PS5 Pro Enhancements
What is AI upscaling in gaming?
AI upscaling in gaming refers to the use of artificial intelligence algorithms to enhance lower-resolution images or frames to higher resolutions, improving visual quality and frame rates without compromising performance.
How does FSR 4 technology work on PS5 Pro?
FSR 4 technology uses machine learning to upscale graphics in real-time, providing sharper visuals and improved performance by taking lower-resolution frames and generating higher-resolution outputs effectively.
Will AI NPCs improve gaming experiences?
AI NPCs are designed to enhance interactivity within games; however, early implementations, such as Sony’s AI Aloy demo, highlight challenges in achieving organic interaction. While the technology shows promise, its effectiveness remains to be seen.
How much will the PlayStation 5 Pro cost in EUR?
The PlayStation 5 Pro is priced at approximately €700.