Episode Details
Back to Episodes
From Sensor to Dashboard: The MQTT Pipeline Through Azure IoT Hub
Season 4
Published 2 days, 18 hours ago
Description
When a machine stops, a planner needs more than a red line on a dashboard. They need to know what stopped, why it stopped, which order sits on that line, and whether the production plan can still hold. Moving raw signals from a factory floor into cloud analytics requires a reliable architecture that spans field sensors, industrial gateways, message brokers, and cloud ingestion layers.
CAPTURING THE SIGNAL AT THE EDGEA sensor signal is not yet manufacturing information. Picture a packaging line where a conveyor motor temperature rises beyond normal operating limits. At that moment, the programmable logic controller (PLC) holds a raw tag value—such as a temperature reading, a timestamp, and a quality state.
However, older plants often run multiple generations of equipment using proprietary protocols or OPC UA, meaning PLCs rarely speak cloud MQTT directly. An industrial gateway deployed on the operational technology (OT) network bridges this gap by:
Become a supporter of this podcast: https://www.spreaker.com/podcast/m365-fm-a-microsoft-mvp-podcast-by-mirko-peters--6704921/support.
CAPTURING THE SIGNAL AT THE EDGEA sensor signal is not yet manufacturing information. Picture a packaging line where a conveyor motor temperature rises beyond normal operating limits. At that moment, the programmable logic controller (PLC) holds a raw tag value—such as a temperature reading, a timestamp, and a quality state.
However, older plants often run multiple generations of equipment using proprietary protocols or OPC UA, meaning PLCs rarely speak cloud MQTT directly. An industrial gateway deployed on the operational technology (OT) network bridges this gap by:
- Normalizing Data: Translating disparate formats, scales, and engineering tags into a common message shape.
- Managing Collection Frequency: Aggregating high-frequency scans into meaningful intervals while forwarding state changes immediately.
- Buffering Locally: Storing data securely during network outages and replaying it safely once connectivity returns.
- Publish-Subscribe Decoupling: Publishers send messages to a known topic without needing to know which downstream systems or applications consume them.
- Topic Structure: Topics act as transport addresses for categories of messages, but they should not be overloaded to serve as a full factory asset model.
- Payload Contracts: The actual message body must explicitly carry stable source asset identifiers, measured values, units, timestamps, and quality flags.
- Device Identity & Authentication: Every gateway requires a secure, registered device identity in IoT Hub using either Shared Access Signatures (SAS) or X.509 certificates.
- Transport Security: Connections rely on TLS (Transport Layer Security) to protect data in transit across network boundaries and firewalls.
- Built-in Endpoints: IoT Hub accepts device-to-cloud messages, stamps them with trusted connection metadata, and retains them temporarily before routing them onward.
- Raw History Storage: Routing messages to Azure Blob or Data Lake Storage preserves an unaltered audit trail for engineering reviews and reprocessing.
- Stream Processing: Endpoints like Event Hubs feed near-real-time streaming consumers and alert rules to notify maintenance teams of abnormal conditions.
- Analytical Models: Integrating data streams into platforms like Microsoft Fabric helps combine telemetry with enterprise planning and execution context.
Become a supporter of this podcast: https://www.spreaker.com/podcast/m365-fm-a-microsoft-mvp-podcast-by-mirko-peters--6704921/support.