AI Supply Chain Security (Model Scanner)

Service · Audit & assessment by HiddenLayer

HiddenLayer AI Supply Chain Security (Model Scanner) provides deep inspection and verification of AI models to detect malware, backdoors, and tampering. It is used by major enterprises and cloud providers like Microsoft to ensure the integrity of open-source and proprietary models before deployment.

Category: Application Security

Detection Targets
Malware, CVEs, backdoors, tampered weights, and artifacts
Model Types Supported
Proprietary, vendor, open-source, and third-party models
Cloud Integrations
AWS, Azure, GCP
Governance Frameworks
NIST, OWASP, ATLAS, FFIEC, OCC
Analysis Method
Non-invasive, no training data required
Key Output
AI Bill of Materials (AI BoM)
  • Scans models for malware, CVEs, and backdoors
  • Integrated with Microsoft Azure AI model catalog
  • Generates a comprehensive AI Bill of Materials (AI BoM)
  • Identifies model lineage, origin, and licensing
  • Requires no training data for analysis

Overview

HiddenLayer AI Supply Chain Security (Model Scanner) is an audit and assessment service that identifies vulnerabilities in AI models before they reach production. It serves enterprises and government agencies by scanning proprietary, vendor, and open-source models for malware, backdoors, and tampered weights. The service is notably used by Microsoft to verify open-source models within the Azure AI model catalog, providing a stamp of integrity on model cards. By generating a detailed AI Bill of Materials (AI BoM) and tracking model genealogy, it allows security teams to manage third-party risk without needing access to sensitive training data. The platform integrates with existing MLOps and CI/CD pipelines to ensure that only verified, compliant models are deployed.

Model Analysis and Inspection

  • Model File Inspection: The service analyzes model architectures, layers, weights, and artifacts to identify tampering or anomalies.
  • Multi-Source Scanning: The scanner identifies hidden risks in third-party, vendor, open-source, and proprietary models.
  • AI Risk Management: It detects malicious model changes and assesses the associated risk to the enterprise.

Supply Chain Visibility

  • AI Bill of Materials (AI BoM): The service unpacks model files, metadata, and supporting components to provide a clear view of the model's building blocks.
  • AI Model Genealogy: It tracks model versions, lineage, and provenance over time to ensure integrity.
  • Lineage and Licensing Tracking: The scanner identifies where models come from, including their country of origin and specific licensing.
  • Vendor Model Compliance: It tests commercial vendor models for safety and security before they are integrated into enterprise workflows.

Governance and Integration

  • Azure AI Catalog Integration: Microsoft uses the scanner to verify open-source models curated in the Azure AI model catalog.
  • Model Card Verification: Scanned models receive verification on their model cards, confirming they are free from vulnerabilities and tampering.
  • Developer Confidence Enhancement: The service enables developers to deploy open-source models with greater confidence by providing third-party validation.
  • AI Security Posture Management (AI SPM): It continuously measures and reports on the AI security posture of the organization's model inventory.

What's included

  • Proprietary models, vendor models, open-source models, and third-party models

Deliverables

  • AI Bill of Materials (AI BoM), Risk scoring, Model card verification, AI Security Posture reports

Use cases

  • Security teams scan third-party models from open-source repositories to detect hidden backdoors before internal use.
  • Developers use the Azure AI catalog integration to verify that curated models are free from vulnerabilities and tampering.
  • Compliance officers generate an AI Bill of Materials (AI BoM) to document model lineage and licensing for regulatory audits.

Specifications

Industries served
Financial Services, Technology, US Federal Government, Healthcare
Detection Targets
Malware, CVEs, backdoors, tampered weights, and artifacts
Model Types Supported
Proprietary, vendor, open-source, and third-party models
Cloud Integrations
AWS, Azure, GCP
Governance Frameworks
NIST, OWASP, ATLAS, FFIEC, OCC
Analysis Method
Non-invasive, no training data required
Key Output
AI Bill of Materials (AI BoM)
Tracking Capabilities
Lineage, country of origin, and licensing

How it works

  1. Discovery and Identification: The scanner identifies and inventories models from various sources, including multi-cloud environments like AWS, Azure, and GCP.
  2. Deep Model Inspection: The service performs deep inspection of model files, weights, and architectures to detect tampering, malware, or backdoors.
  3. Risk Assessment and Reporting: It generates an AI Bill of Materials and risk scores, mapping findings to governance frameworks like NIST or OWASP.
  4. Verification and Deployment: Verified models are cleared for deployment, with ongoing monitoring of their security posture as they evolve.

FAQ

How does the Model Scanner detect hidden risks?

The scanner analyzes model architectures, layers, weights, and artifacts for tampering, anomalies, and malicious code without requiring access to the customer's training data.

Is the Model Scanner integrated with Azure?

Microsoft uses HiddenLayer’s Model Scanner to scan open-source models in the Azure AI model catalog, providing verification that they are free from vulnerabilities and tampering.

What is included in the AI Bill of Materials (AI BoM)?

The AI BoM unpacks model files, metadata, and supporting components, giving organizations complete visibility into the building blocks of their AI systems.

Can it scan third-party vendor models?

Yes, the service is designed to scan proprietary, vendor-provided, and open-source models before they reach production environments.

Request a Demo

Added by AntSpace from public sources (hiddenlayer.com).

Related

More services by HiddenLayer