Rhino Speech-to-Intent

AI model by Picovoice

On-device spoken language understanding for private, zero-latency voice interfaces.

Rhino is an on-device speech-to-intent engine that extracts structured meaning directly from voice commands. It is built for developers who need private, zero-latency voice interfaces for specific domains like smart homes or industrial tools.

Model specs

The full spec card (context, pricing per token, modalities and more) on AntSpace. Sign up free to see the full spec card.

Languages
English

Category: Natural Language Processing

Modalities
Audio → Intent, Entities
Access
SDK, Picovoice Console, WebAssembly
Fine-tuning
Custom contexts trained via Picovoice Console
Command Acceptance Rate
97.3%
Error Reduction
6x fewer errors vs cloud average
Deployment Architecture
Edge-first / On-device
  • 97.3% Command Acceptance Rate
  • 6x fewer errors than major cloud providers
  • Runs entirely on-device for zero latency
  • Supports Android, iOS, Web, and Microcontrollers
  • Custom context training via Picovoice Console

Overview

Rhino Speech-to-Intent is an on-device spoken language understanding engine developed by Picovoice for businesses building voice-controlled products. It replaces the traditional two-step pipeline of speech-to-text followed by natural language understanding with a single end-to-end model that infers intent directly from audio. This architecture allows Rhino to achieve a 97.3% command acceptance rate while running entirely offline on the user's device. It is designed for specific domains such as smart home appliances, automotive systems, and industrial equipment where privacy and low latency are critical. Rhino supports a wide range of platforms from microcontrollers to web browsers and can be customized through the Picovoice Console without machine learning expertise.

Natural Language Understanding

  • End-to-End Inference: The engine directly infers meaning, including intent and entities, from voice commands without an intermediate text transcript.
  • 6x Fewer Errors: The model makes 6x fewer errors compared to the average of major cloud NLU providers.
  • Deterministic Recognition: It maps speech straight to intent to avoid the accumulation of errors typical in two-step STT-plus-NLU pipelines.

Performance and Privacy

  • On-Device Privacy: Voice recognition is entirely offline and intrinsically private, ensuring data never leaves the device.
  • Zero-Latency Processing: The edge-first architecture eliminates unpredictable network delays for immediate response.
  • Noise Resilience: The engine is resilient to noise and reverberation, maintaining accuracy in real-world environments.

Customization and Tooling

  • Picovoice Console Training: Developers can design, train, and test custom voice interfaces instantly in a web browser using the Picovoice Console.
  • Custom Context Design: The platform allows for the definition of custom contexts, intents, and slots for specific domains.
  • No-Code Training Flow: No machine learning skills are required to describe needs with text and export trained models.

Deployment and Integration

  • Broad OS Support: Rhino supports deployment on Android, iOS, Linux, macOS, Windows, and Raspberry Pi.
  • Microcontroller Compatibility: The engine runs on microcontrollers including Arduino and other embedded systems.
  • Web Browser Support: Web integration is supported across Chrome, Edge, Firefox, and Safari using WebAssembly.
  • Developer SDKs: SDKs are available for languages and frameworks including C,.NET, Java, Node.js, Python, Flutter, React, and React Native.

Benchmarks

  • Command Acceptance Rate: 97.3%

Use cases

  • Smart home manufacturers build voice-controlled appliances that process commands locally for instant response and user privacy.
  • Automotive engineers integrate offline voice interfaces into infotainment systems to ensure reliable control without a data connection.
  • Industrial equipment designers create hands-free controls for machinery that operate accurately in noisy factory environments.
  • Web developers add private voice command features to browser-based applications using WebAssembly for local processing.

Specifications

Modalities
Audio → Intent, Entities
Access
SDK, Picovoice Console, WebAssembly
Fine-tuning
Custom contexts trained via Picovoice Console
Command Acceptance Rate
97.3%
Error Reduction
6x fewer errors vs cloud average
Deployment Architecture
Edge-first / On-device
Input Modality
Audio
Output Modality
Structured Intent and Slots
Supported Browsers
Chrome, Edge, Firefox, Safari
Mobile Support
Android, iOS, Flutter, React Native
Desktop Support
Windows, macOS, Linux
Embedded Support
Raspberry Pi, Arduino, Microcontrollers

How it works

  1. Design Context: Developers use the Picovoice Console in a web browser to define the specific intents, slots, and variables required for their application's domain.
  2. Train Model: The platform trains a custom speech-to-intent model based on the text descriptions provided, requiring no manual machine learning effort.
  3. Export and Integrate: The trained model is exported and integrated into applications using Picovoice SDKs for mobile, desktop, web, or embedded platforms.
  4. On-Device Inference: The engine processes audio locally on the user's device, extracting structured intent directly from speech without sending data to the cloud.

FAQ

How does Rhino differ from traditional NLU engines?

Rhino uses an end-to-end approach that fuses speech-to-text and NLU into a single model, directly inferring meaning from voice commands to increase accuracy and reduce costs.

How do I train a custom model for Rhino?

Developers use the Picovoice Console to describe their requirements in text, train the model in the browser, and export it for deployment without needing machine learning expertise.

Added by AntSpace from public sources (picovoice.ai).

Related

More AI models by Picovoice