NVIDIA AI Foundry

Service · Custom development by Nvidia

Build custom generative AI models with your enterprise data and NVIDIA's expertise.

NVIDIA AI Foundry is a platform and service for building custom generative AI models with enterprise data and domain-specific knowledge. It provides access to NVIDIA's AI models, NeMo software for customization, and dedicated capacity on NVIDIA DGX Cloud, delivering custom models as NVIDIA NIM inference microservices for flexible deployment.

Category: Generative AI

Engagement model
Fixed project, Retainer, Time and materials, Subscription
Delivery
Remote, On-site, Hybrid
Team
NVIDIA AI experts, Specialized development teams
Customization Software
NVIDIA NeMo
Deployment Output
NVIDIA NIM inference microservice
Infrastructure
NVIDIA DGX Cloud

Overview

NVIDIA AI Foundry is a comprehensive platform and service designed for enterprises to build custom generative AI models. It leverages proprietary enterprise data and domain-specific knowledge, functioning akin to a chip foundry by providing access to NVIDIA's AI models, the NeMo software for model customization, and dedicated capacity on NVIDIA DGX Cloud, all backed by NVIDIA AI experts. The service culminates in the delivery of NVIDIA NIM inference microservices, which include the custom model, optimized engines, and a standard API for flexible deployment. This enables organizations to develop their own AI models tailored to their specific needs, protecting data privacy and intellectual property while accelerating time to solution and achieving unprecedented performance.

Capabilities

What's included

How it works

Use cases

Specifications

Engagement model
Fixed project, Retainer, Time and materials, Subscription
Delivery
Remote, On-site, Hybrid
Team
NVIDIA AI experts, Specialized development teams
Industries served
Automotive, Financial Services, Healthcare, Manufacturing, Retail, Telecommunications, Media and Entertainment, Government, Energy, Consumer Goods, Industrial Manufacturing, Aerospace and Defense, Biotechnology, Pharmaceuticals, Higher Education, Research Institutions
Foundation Models Available
NVIDIA-created models (Nemotron, Edify), Popular open foundation models
Customization Software
NVIDIA NeMo
Deployment Output
NVIDIA NIM inference microservice
Infrastructure
NVIDIA DGX Cloud
Expertise
NVIDIA AI experts

How it works

  1. Model Customization: Start with NVIDIA-created or popular open foundation models. Customize these models using NVIDIA NeMo software, incorporating enterprise data and domain expertise.
  2. Evaluation and Guardrails: Evaluate the customized model and apply guardrails to ensure safety and alignment with business requirements.
  3. NIM Microservice Packaging: The customized model is packaged as an NVIDIA NIM inference microservice, complete with optimized engines and a standard API.
  4. Application Deployment and Improvement: Deploy the NIM microservice to build generative AI-powered applications. Feed knowledge gained from deployed applications back into the foundry to further improve custom models.

FAQ

What is NVIDIA AI Foundry?

NVIDIA AI Foundry is a platform and service for building custom generative AI models using your enterprise data and domain-specific knowledge. It provides access to NVIDIA's AI models, NeMo software for customization, and dedicated capacity on NVIDIA DGX Cloud, delivering custom models as NVIDIA NIM inference microservices.

What foundation models can I use with NVIDIA AI Foundry?

Enterprises can start with NVIDIA-created models like Nemotron and Edify, or popular open foundation models, and customize them using NVIDIA NeMo software. These models can then be deployed as NVIDIA NIM inference microservices.

What types of custom models can be built with NVIDIA AI Foundry?

NVIDIA AI Foundry enables the creation of custom models for various enterprise applications, including those requiring tailored language understanding, vision capabilities, speech processing, and healthcare-specific AI. Examples include customizing models for specific organizational, industrial, or cultural needs.

What infrastructure is used for model development?

NVIDIA AI Foundry provides dedicated capacity on NVIDIA DGX Cloud, which is built and backed by NVIDIA AI experts, ensuring efficient model development and access to state-of-the-art infrastructure.

What is the output of NVIDIA AI Foundry?

The output is an NVIDIA NIM inference microservice, which includes the custom model, optimized engines, and a standard API, allowing for flexible deployment across various environments.

How does NVIDIA AI Foundry help accelerate development?

NVIDIA AI Foundry helps accelerate the time to solution by allowing organizations to focus on leveraging their data and AI insights, rather than maintaining and tuning the AI development platform.