NVIDIA's ACE Technology Brings AI-Powered NPCs to Life in Upcoming Game
2 Sources
2 Sources
[1]
NVIDIA's ACE virtual human tech is making its way into an actual game
A game developer called Amazing Seasun Games is demonstrating NVIDIA's Avatar Cloud Engine (ACE) technology through its upcoming multiplayer mecha game Mecha BREAK at Gamescom this year. NVIDIA unveiled ACE at Computer 2023, presenting it as a "custom AI model foundry service" that developers can use to make their games more interactive. Specifically, it will allow players to interact with NPCs without the constraints of pre-programmed conversations and will be able to give them appropriate responses. When NVIDIA launched the technology, it showed a player talking to an NPC called Jin at a ramen shop. The player asked how the character was, and Jin was able to respond naturally to tell them about his worries about his city's rising crime rates. NVIDIA said the developer will use its technology to bring Mecha BREAK's "characters to life and provide a more dynamic and immersive gameplay experience on GeForce RTX AI PCs." The chipmaker also said that more developers are incorporating ACE into their creations. Perfect World Games, a Chinese developer, is using the technology to power its demo for Legends. In that game, or at least the demo of it, a character is able to identify people and objects in the real world through the computer's camera, thanks to ChatGPT-4o. In addition to the ACE demo in Mecha BREAK, NVIDIA has also announced that PC Game Pass access on GeForce NOW will become seamless starting on August 22. Players will only have to link their Xbox profile once to be able to easily stream Game Pass titles in the future.
[2]
NVIDIA ACE Demoed For The First Time In An Actual Game, Bringing AI-Powered Interactions To Mecha BREAK
NVIDIA has demoed its ACE technology in an actual game for the very first time, showcasing AI-powered interactions in Mecha BREAK. At Gamescom 2024, NVIDIA is once again demoing its ACE technology but this time, the demo isn't a hand-crafted experience like Covert Protocol or Ramen Shop but an actual game. This is possible using the latest small language model for game characters known as Nemotron-4 which has 4B (4 Billion parameter) NIM. The small and less complicated models are easy to run on platforms such as gaming PCs and offer quick responses versus traditional LLMs (Large Language Models). The Nemotron-4 4B NIM model was shown integrated within the very first title, Mecha BREAK by Amazing Seasun Games. The demo not only features Nemotron-4 but also leverages Audio2Face-3D NIM which is used to offer dynamic facial animations. Besides these, there are also 3rd party models integrated within the game such as Whisper which provides speech recognition, and Elevenlabs which provides realistic voices (runs on the cloud). ACE & digital human technologies showcased in first game, Mecha BREAK NVIDIA ACE is a revolutionary suite of digital human technologies that bring digital humans to life. ACE made its debut in the Ramen Shop demo at Computex 2023, but ACE has evolved rapidly. At Gamescom 2024, we announced that its first digital human small language model is being demonstrated in Mecha BREAK, a new multiplayer mech game developed by Amazing Seasun Games, to bring its characters to life and provide a more dynamic and immersive gameplay experience on GeForce RTX AI PCs. Mecha BREAK, developed by Amazing Seasun Games, a Kingsoft Corporation game subsidiary, is showcasing the NVIDIA Nemotron-4 4B Instruct NIM running on device in the first showcase of ACE-powered game interactions. And this is just the start, as more developers are incorporating NVIDIA ACE technologies into their games and applications. Global game publisher and developer Perfect World Games is advancing its NVIDIA ACE and digital human technology demo, Legends, with new AI-powered vision capabilities. Within the demo, the character Yun Ni can see gamers and identify people and objects in the real world using the computer's camera powered by ChatGPT-4o, adding an augmented reality layer to the gameplay experience. These capabilities unlock a new level of immersion and accessibility for PC games. via NVIDIA GeForce Coming back to the game, Mecha BREAK features a 6v6 combat between various mechs that a player can choose from. Each mech has different loadouts and abilities so making the right choice matters a lot before you land in the action. That's where the engineer character in the hangar bay comes in who can assist the player with various things such as mission objectives, preferred mech choice, and more. The NVIDIA ACE technology and NIM models are applied to this segment of the game where you can interact with the character through voice recognition and have a life-like and responsive conversation on the go. NVIDIA will have a full suite of ACE demos showcased during Gamescom 2024 along with the Mecha BREAK integration. We can't wait to try these out ourselves and we can expect more AI integrations for NPCs in future game titles too.
Share
Share
Copy Link
NVIDIA's Avatar Cloud Engine (ACE) technology is set to debut in an actual game, promising more realistic and engaging NPC interactions. The upcoming mecha combat game 'Mecha Break' will showcase this groundbreaking AI-powered feature.
NVIDIA's ACE Technology Makes Its Gaming Debut
NVIDIA's Avatar Cloud Engine (ACE) technology, first unveiled at CES 2023, is finally making its way into an actual game. This groundbreaking AI-powered system is set to revolutionize non-player character (NPC) interactions in video games, offering more realistic and engaging experiences for players
1
.Mecha Break: The First Game to Implement ACE
The honor of being the first game to implement NVIDIA's ACE technology goes to 'Mecha Break,' an upcoming mecha combat game developed by Seasun Games. This Chinese developer is at the forefront of integrating AI-powered NPCs into their game, showcasing the potential of this new technology
2
.Enhanced NPC Interactions
ACE technology aims to create more lifelike and responsive NPCs by leveraging advanced AI algorithms. These AI-powered characters can engage in natural conversations with players, responding to voice commands and adapting their behavior based on the player's actions and choices. This level of interactivity promises to add depth and immersion to the gaming experience
1
.Technical Aspects of ACE
NVIDIA's ACE technology combines several AI models to create its virtual humans. These models include audio-to-text transcription, natural language processing, text-to-speech synthesis, and computer vision. By integrating these components, ACE can generate realistic facial animations and voice responses, making NPCs more believable and engaging
2
.Potential Impact on the Gaming Industry
The introduction of ACE technology in 'Mecha Break' marks a significant milestone in the gaming industry. As this technology becomes more widespread, it has the potential to transform how players interact with virtual worlds and characters. Game developers may soon have the tools to create more dynamic and responsive game environments, leading to richer storytelling and more immersive gameplay experiences
1
.Related Stories
Challenges and Considerations
While the promise of AI-powered NPCs is exciting, there are potential challenges to consider. Game developers will need to balance the use of this technology with traditional scripted interactions to ensure a cohesive narrative experience. Additionally, there may be concerns about the computational requirements for running these AI models, particularly for players with less powerful hardware
2
.Future Prospects
As NVIDIA continues to refine and expand its ACE technology, we can expect to see more games adopting this feature in the future. The success of its implementation in 'Mecha Break' could pave the way for wider adoption across the gaming industry, potentially leading to a new era of interactive and responsive virtual worlds
1
2
.References
Summarized by
Navi
Related Stories
Weekly Highlights
1
Anthropic Secures $13B in Funding, Reaching $183B Valuation Amid AI Industry Boom
Business and Economy
2
Tesla Proposes $1 Trillion Pay Package for Elon Musk Tied to Ambitious AI and Robotics Goals
Business and Economy
3
Anthropic's $1.5B AI Copyright Settlement: A Landmark Deal Under Scrutiny
Policy and Regulation
Weekly Highlights
Explore today's top stories
Your Daily Dose of Curated AI News
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.
