Video Analytics Agents
AI agent · Computer-use / browser agent by NVIDIA
AI-powered video assistants that see, reason, and act on real-world visual data.
NVIDIA Video Analytics Agents are AI-powered assistants that perceive, reason, and act on live or recorded video using natural language. Built with the Metropolis VSS Blueprint and NVIDIA Cosmos, they help operations teams in retail, industrial, and transportation sectors automate insights and decision-making.
Agent specs
The full spec card (context, pricing per token, modalities and more) on AntSpace. Sign up free to see the full spec card.
- Languages
- English
Category: AI Agents
- Deployment
- NVIDIA AI Factory, Cloud, On-premises, Edge
- Core Models
- NVIDIA Cosmos, Vision-Language Models (VLM), LLMs
- Reference Architecture
- NVIDIA Metropolis VSS Blueprint
- Data Sources
- Live and recorded video streams
- Interaction Interface
- Natural language queries
- Deployment Environments
- Industrial, Retail, Transportation, Infrastructure
- Powered by NVIDIA Cosmos generative world foundation models
- Built with NVIDIA Metropolis VSS Blueprint reference architecture
- Natural language search and summarization for live and recorded video
- Deploys across factories, warehouses, retail, airports, and roadways
Overview
NVIDIA Video Analytics Agents are AI-powered assistants designed for enterprises to perceive, reason, and act on massive volumes of live or recorded video data. They are built using the NVIDIA Metropolis VSS Blueprint and powered by NVIDIA Cosmos generative world foundation models to support physical AI capabilities. The agents are deployed across diverse environments including factories, warehouses, retail stores, airports, and roadways. By enabling natural language search and summarization, they help operations teams make faster, more informed decisions and unlock new possibilities for automation. These agents run on NVIDIA AI Factory infrastructure, ensuring the speed and scale required for production-grade video processing.
Video Intelligence and Reasoning
- Contextual Reasoning: The agents go beyond simple detection to perceive, reason, and act on massive volumes of video to unlock new possibilities for automation.
- Operational Decision Support: Operations teams can use these agents to make better decisions faster by extracting insights from real-world visual data.
Technical Foundation and Scaling
- Metropolis VSS Blueprint: Video Analytics Agents are built using the NVIDIA Metropolis VSS Blueprint for structured development of video search and summarization.
- NVIDIA Cosmos Integration: The agents are powered by NVIDIA Cosmos generative world foundation models for advanced physical AI capabilities.
- Vision-Language Models: The agents leverage vision-language models (VLM) to interpret complex visual scenes and natural language queries.
What it does
- Perceive live and recorded video\nReason about video context and complexity\nSearch video archives using natural language\nSummarize video content\nAct on video insights for automation
Use cases
- Operations teams in warehouses use natural language to search through hours of recorded video for specific events or anomalies.
- Retail managers generate summaries of store activity to understand customer flow and operational bottlenecks without manual review.
- Factory supervisors deploy agents to perceive and reason about complex industrial processes for real-time safety and efficiency monitoring.
- Transportation authorities use video analytics agents to understand and act on traffic patterns across massive roadway networks.
Specifications
- Models
- NVIDIA Cosmos, Vision-Language Models (VLM), Large Language Models (LLM)
- Deployment
- NVIDIA AI Factory, Cloud, On-premises, Edge
- Core Models
- NVIDIA Cosmos, Vision-Language Models (VLM), LLMs
- Reference Architecture
- NVIDIA Metropolis VSS Blueprint
- Data Sources
- Live and recorded video streams
- Interaction Interface
- Natural language queries
- Deployment Environments
- Industrial, Retail, Transportation, Infrastructure
- Infrastructure Support
- NVIDIA AI Factory
FAQ
What technologies power these agents?
They are built using the NVIDIA Metropolis VSS Blueprint and powered by NVIDIA Cosmos generative world foundation models.
Where can Video Analytics Agents be deployed?
They are used in factories, warehouses, retail stores, airports, and roadways to help operations teams make better decisions faster.
How do users interact with these agents?
Users can search, summarize, and understand video through natural language queries.
Added by AntSpace from public sources (nvidia.com).