Microsoft Fabric
Microsoft Fabric is a new data platform from Microsoft that includes a number of the core Azure services and allows data engineering, integration, analytics, and intelligence all in one place, built on top of OneLake. Although Microsoft Fabric is new, a lot of the existing Azure services can be used to ingest data into Fabric. This page covers the different integration options.
Realtime Data
Real-Time Intelligence (RTI) in Microsoft Fabric focuses on realtime data ingestion, exploration, and analysis. It’s the ideal entry point for realtime machine and telemetry data. The Intelligence Hub gets data into RTI using RTI’s Eventstreams. Eventstreams is a generic term for the different integration options available in RTI for realtime data. The following options exist today.
Integration | Notes |
---|---|
Event Hubs | Event Hubs is the ideal integration and can be setup as an independent Event Hub that RTI consumes from or an Event Hub endpoint hosted in RTI. The Intelligence Hub publishes to the Event Hub and RTI consumes the events. |
IoT Hub | This is similar to Event Hubs, but must be hosted as an independent IoT Hub service. IntelligenceHub publishes to IoT Hub and RTI consumes the events. |
MQTT | This requires a 3rd party broker be configured. The IntelligenceHub publishes and RTI consumes. |
Kafka | This requires a 3rd party Kafka cluster to be setup. The IntelligenceHub publishes and RTI consumes. |
Other | See the latest RTI Eventstreams documentation for the latest RTI integrations. |
Bulk Data
For bulk data ingestion, which can be historical or MES data, as well as buffered realtime data, Azure Blob storage is the ideal integration point. The Azure Blob connection can be used to upload the data to Blob or Gen2 storage, and RTI can access it from there.