NVIDIA ACE (Avatar Cloud Engine)

AI agent · Voice agent by Nvidia

NVIDIA ACE (Avatar Cloud Engine) is a platform for building interactive digital avatars and conversational AI agents. It integrates advanced AI models for speech, natural language understanding, and animation to create lifelike characters for customer service and gaming. ACE offers a secure, scalable, and customizable solution for businesses to enhance customer engagement and operational efficiency.

Category: Conversational AI

Channels

Cloud, On-Premises

Deployment

Cloud, On-Premise

Languages

Italian, EU Spanish, German, Mandarin

Languages Supported

Italian, EU Spanish, German, Mandarin

Deployment Options

Cloud, On-Premise

• Creates lifelike digital avatars for enhanced customer experiences.
• Integrates custom language models, speech, and animation for authentic interactions.
• Provides secure, cloud-powered delivery with low-latency responses.
• Enables 24/7 virtual support, reducing operational costs.
• Supports integration with various NVIDIA AI technologies and LLMs.

Overview

NVIDIA ACE (Avatar Cloud Engine) is a comprehensive suite of AI technologies designed for creating interactive digital avatars and human applications at scale. It empowers developers to build knowledgeable, actionable, and conversational characters for various use cases, including customer service and gaming. ACE offers a modular, open microservice platform that integrates state-of-the-art AI models for speech, natural language understanding, and animation, enabling lifelike and empathetic interactions. By leveraging cloud and on-device resources, ACE delivers real-time performance with low latency, providing secure and customizable solutions for businesses seeking to enhance customer experiences and operational efficiency.

Core Capabilities

• Lifelike Avatars: Enables creation of lifelike 3D avatars with realistic facial animation for authentic and empathetic interactions.
• Real-time Conversation: Blends real-time conversation, emotional expression, and in-depth brand knowledge for engaging customer experiences.
• Secure Cloud Delivery: Provides secure, cloud-powered delivery of AI services with low-latency responses.
• Uninterrupted Support: Offers 24/7 virtual product expert support, reducing operational expenses compared to human agents.

AI Model Integrations

• Custom Language Models: Integrates custom language models for natural language understanding and response generation.
• Real-time Facial Animation: Supports real-time facial animation and lip-syncing for dynamic avatar expressions.
• Secure Cloud Delivery: Provides secure, cloud-powered delivery of AI services.
• NVIDIA Riva Integration: Enables integration with NVIDIA Riva for speech and translation AI.
• NVIDIA NeMo LLM Integration: Supports NeMo LLM for natural language understanding.
• NVIDIA Audio2Face Integration: Includes Audio2Face for generating facial expressions and lip movements.
• NVIDIA Animation Graph Integration: Works with Animation Graph for character animation.
• NVIDIA Omniverse Renderer Integration: Supports Omniverse Renderer for avatar rendering.
• NVIDIA A2F Animation Integration: Offers AI-powered 2D and 3D character animation through A2F.

Use Cases

• Virtual Customer Service: Enables creation of AI-driven virtual customer service solutions.
• Enhanced Customer Experience: Transforms customer experience with instant, personalized service.
• Virtual Product Experts: Provides virtual product experts for customer inquiries.
• AI-Powered Customer Support: Offers AI-powered solutions for customer support.

Agent Architecture & Integration

• LLM-Driven Conversational AI Agents: ACE Agent microservices help build LLM-driven scalable and customizable conversational AI agents.
• Speech-Based Bot Orchestration: The Chat Controller orchestrates end-to-end bot pipelines for speech-based bots.
• Custom Business Logic Integration: The Plugin server enables interaction with custom business logic via REST.
• NLP Model Integration: The NLP server exposes unified RESTful interfaces for NLP models.
• Retrieval Augmented Generation (RAG) Integration: Supports integration with Retrieval Augmented Generation (RAG) workflows.
• TensorRT Optimization for Low Latency: ACE Agent uses NVIDIA TensorRT optimizations for low-latency interactions.
• gRPC API Support for Streaming Speech: Supports gRPC APIs for streaming low-latency speech.
• REST API Support for Text Chatbots: Supports REST APIs for text-only chatbots.

What it does

• Builds conversational AI agents. Orchestrates speech and text interactions. Integrates with custom business logic. Deploys NLP models. Supports RAG workflows.

Use cases

• Enhancing customer service with virtual agents.
• Creating interactive characters for gaming.
• Developing digital humans for various applications.
• Providing real-time, personalized customer support.
• Enabling empathetic and authentic avatar interactions.
• Automating customer inquiries with AI-powered responses.

Specifications

Channels

Cloud, On-Premises

Integrations

NVIDIA Riva, NVIDIA NeMo LLM, NVIDIA Audio2Face, NVIDIA Omniverse Renderer, NVIDIA A2F, LangChain, LlamaIndex, NVIDIA Triton Inference Server

Human control

Customizable bot behavior via Colang. Integration with custom business logic via Plugin server.

Models

NVIDIA Riva, NVIDIA NeMo LLM, NVIDIA Audio2Face, NVIDIA Triton Inference Server, Colang 2.0

Deployment

Cloud, On-Premise

Languages

Italian, EU Spanish, German, Mandarin

Languages Supported

Italian, EU Spanish, German, Mandarin

Key Integrations

NVIDIA Riva, NVIDIA NeMo LLM, NVIDIA Audio2Face, NVIDIA Omniverse Renderer, NVIDIA A2F, LangChain, LlamaIndex, NVIDIA Triton Inference Server

Deployment Options

Cloud, On-Premise

How it works

1. Avatar Development: Develops digital avatars using a suite of AI technologies and microservices.
2. AI Integration: Integrates custom language models, speech AI (Riva), and animation (Audio2Face) for dynamic character responses.
3. Deployment: Deploys avatars securely via cloud or on-premises for real-time interactions.
4. Customization and Integration: Enables customization of bot behavior and integration with custom business logic.

Pricing

NVIDIA AI Enterprise license

Included with NVIDIA AI Enterprise license

FAQ

What is NVIDIA ACE for Games?

NVIDIA ACE is a suite of AI technologies designed to help middleware and game developers build knowledgeable, actionable, and conversational in-game characters. ACE provides ready-to-integrate cloud and on-device AI models for speech, intelligence, and animation.

What kind of AI models does ACE offer for games?

ACE offers small AI models—from speech to vision— built to enhance game characters. These models are fine-tuned and optimized for gaming hardware, providing high accuracy and low latency within a small memory footprint.

What are NVIDIA In-Game Inferencing (NVIGI) plugins?

NVIDIA In-Game Inferencing (NVIGI) plugins schedule AI inference for different models and inference backends across complex graphics workloads to maximize performance and the user experience.

Are there ACE plugins for Unreal Engine 5?

For Unreal Engine 5 developers and technical artists, a suite of NVIDIA ACE plugins is available to streamline the end-to-end AI NPC pipeline. They are local, RTX-optimized workflows bundled with ready-to-use models, governed by the MIT license.

What is the Game Agent SDK?

The Game Agent SDK (Beta) is a lightweight, C/C++ agentic framework designed for seamless, native in-game integration. Its Agent, Chat and RAG APIs help developers connect NPCs to game state, contextual knowledge and model-driven actions.