Orbital Data Connect
Product · SaaS / cloud software by Applied Computing
An AI-ready data foundation for the energy industry.
Orbital Data Connect is a data integration platform for energy operators that bridges on-premise industrial systems with the Databricks Lakehouse. It creates an AI-ready foundation by unifying time-series, structured, and document data into a single governed environment.
Category: Data Integration
- Deployment
- Hybrid (On-premise to Databricks Lakehouse)
- Platforms
- Databricks Lakehouse (AWS)
- Supported Protocols
- OPC UA, Port 4840, HDA
- Data Types
- Time-series, Structured, Unstructured (Documents)
- Cloud Environment
- Databricks Lakehouse (AWS)
- Governance Framework
- Unity Catalog
- Bridges on-premise industrial systems to Databricks Lakehouse
- Ingests time-series, structured, and document data
- Fault-tolerant pipeline with gap detection and backfill
- Native integration with Unity Catalog and Delta Lake
Overview
Orbital Data Connect is a data integration and governance platform developed by Applied Computing to bridge on-premise industrial systems with cloud-based AI environments. Specifically designed for the energy industry, it unifies three critical data streams—time-series telemetry, structured records, and engineering documents—into a governed environment on the Databricks Lakehouse. The platform enables energy operators to create an AI-ready data foundation that the Orbital world model can utilize for physics-grounded insights from day one. It features secure IPsec tunneling and a fault-tolerant pipeline equipped with gap detection, backfilling, and deduplication to manage high-volume sensor data. By running natively on Databricks, it leverages Unity Catalog for governance and Delta Lake for reliability, ensuring that operational data remains auditable and under the operator's control.
Data Integration
- Time-Series Ingestion: The platform connects to process historians and OPC UA to ingest both live and historical instrument readings.
- Structured Data Sync: It synchronizes lab results, maintenance records, ERP data, and production logs on a scheduled basis.
- Document Processing: The system processes operating manuals, shift logs, and drawings to make them searchable for AI systems.
- Secure Connectivity: It bridges on-premise data sources to the cloud environment using a secure IPsec tunnel.
Platform Features
- Databricks Native: Orbital Data Connect runs natively on the Databricks Lakehouse platform.
- Unity Catalog Governance: It utilizes Unity Catalog for data governance and access control.
- Delta Lake Reliability: The platform uses Delta Lake to ensure data reliability and maintain full lineage.
- Monitoring and Health: It provides a unified layer for monitoring health, gaps, and alerts across data pipelines.
Pipeline Reliability
- Gap Detection: The pipeline includes gap detection to identify missing data segments.
- Automated Backfill: It features a backfill mechanism to recover historical data after connectivity issues.
- Deduplication: The system automatically removes duplicate entries to maintain data integrity.
- Checkpoint Engine: A checkpoint engine ensures exactly-once processing and reliable recovery.
Use cases
- Energy operators integrate live sensor data from process historians into Databricks for real-time AI monitoring.
- Maintenance teams synchronize ERP records and lab results to provide context for root cause analysis.
- Plant engineers process technical drawings and operating manuals to make them searchable for AI-driven decision support.
- Data engineers use the fault-tolerant pipeline to ensure continuous data flow despite intermittent on-premise connectivity.
Specifications
- Deployment
- Hybrid (On-premise to Databricks Lakehouse)
- Platforms
- Databricks Lakehouse (AWS)
- Integrations
- Databricks, Unity Catalog, Delta Lake, MLflow, OPC UA, Process Historians, ERP systems
- Supported Protocols
- OPC UA, Port 4840, HDA
- Data Types
- Time-series, Structured, Unstructured (Documents)
- Cloud Environment
- Databricks Lakehouse (AWS)
- Governance Framework
- Unity Catalog
- Storage Format
- Delta Lake Tables and Volumes
- Connectivity Method
- Secure IPsec Tunnel
- Processing Modes
- Stream and Batch Ingestion
- Reliability Features
- Gap Detection, Backfill, Deduplication
How it works
- Connect Data Sources: The platform connects to on-premise sources including process historians via OPC UA, ERP systems for structured records, and document repositories.
- Secure Tunneling: A secure IPsec tunnel is established through the L3.5 firewall to bridge on-premise data to the cloud environment.
- Automated Ingestion: Data flows through a fault-tolerant pipeline that handles ingestion, metadata discovery, and document processing.
- Govern on Lakehouse: The data is organized into Delta Lake tables and volumes within the Databricks Lakehouse, governed by Unity Catalog.
- Enable AI Services: The resulting AI-ready data foundation is accessed by the Orbital world model for prediction, optimization, and analysis.
FAQ
What types of data does Orbital Data Connect handle?
The platform brings together three primary types of operational data: time-series telemetry from sensors, structured records from ERP and maintenance systems, and engineering documents like procedures and drawings.
How does it connect on-premise systems to the cloud?
It uses a secure IPsec tunnel to bridge on-premise industrial systems with the cloud-based Databricks environment.
How does it ensure data reliability?
The platform features a fault-tolerant pipeline with gap detection, automated backfilling, and deduplication to ensure data remains current and complete.
Does it require a specific cloud platform?
Orbital Data Connect runs natively on Databricks, utilizing Unity Catalog for governance and Delta Lake for reliability and lineage.
Added by AntSpace from public sources (appliedcomputing.com).