Skip to content

NVIDIA’s AI lets gamers talk to NPCs in video games

NVIDIA’s AI lets gamers talk to NPCs in video games

[ad_1]

NVIDIA unveils Avatar Cloud Engine (ACE) for natural interaction with NPCs in games

In its recent generative AI keynote at Computex 2023, NVIDIA announced the launch of technology called Avatar Cloud Engine (ACE) that enables gamers to speak naturally to non-playable characters (NPCs) and receive appropriate responses. A demo called Kairos showcased the technology, with a playable character talking to an NPC named Jin in a dystopic Ramen shop.

The ACE Demo

The demo showed the player conversing with Jin, with the character asking, Hey Jin, how are you? The NPC responds, Unfortunately, not so good, and continues, I am worried about the crime around here. It’s gotten bad lately. My ramen shop got caught in the crossfire.

While some may argue that the dialogue was a little stiff, the primary objective of the demo was to show that natural interaction between players and NPCs can be achieved by merely speaking into your headset, allowing NPCs to respond appropriately, thus creating a more immersive gaming experience.

The ACE Technology

NVIDIA developed the Avatar Cloud Engine in partnership with Convai to promote ACE’s use. ACE can run both in the cloud and locally on NVIDIA hardware, and it uses NVIDIA NeMo to build, customize, and deploy large language models customized with lore and character backstories while deploying speech recognition and speech-to-text tools called Riva. ACE also deploys Omniverse Audio2Face to create expressive facial animation of game characters.

ACE in Games

Although NVIDIA did not announce any games that would use the ACE technology, Stalker 2: Heart of Chernobyl and Fort Solis have plans to employ Omniverse Audio2Face for their respective games, indicating that the technology could find its way into other games soon.

Conclusion

Overall, NVIDIA’s Avatar Cloud Engine presents an exciting development in the gaming industry. Its ability to enable natural interaction between players and NPCs, foster more immersive gaming experiences, and enable customization of language models is a significant step forward in gaming technology.

FAQ

What is NVIDIA’s Avatar Cloud Engine?

NVIDIA’s Avatar Cloud Engine (ACE) is a technology that allows gamers to speak naturally to non-playable characters (NPCs) in games and receive appropriate responses.

What does the ACE demo entail?

The demo showed a playable character talking to an NPC named Jin in a dystopic-looking Ramen shop. The conversation between the player and Jin was meant to create a natural interaction between the two characters that would make gaming more immersive.

What tools does ACE use?

ACE uses NVIDIA NeMo to build, customize, and deploy large language models customized with lore and character backstories while deploying speech recognition and speech-to-text tools called Riva. ACE also deploys Omniverse Audio2Face to create expressive facial animation of game characters.

What are the benefits of ACE?

The primary benefit of ACE is its ability to enable natural interaction between players and NPCs, making gaming more immersive. Additionally, ACE enables customization of language models, which adds a new level of depth to gaming.

[ad_2]

For more information, please refer this link