Loom Eventstream Editor — Fabric-parity spec¶
Comparative positioning note
This document is written from the perspective of Microsoft Azure, Cloud Scale Analytics, and CSA Loom. Any description of third-party or competing products, services, pricing, or capabilities is derived from publicly available documentation and sources believed accurate at the time of writing, and is provided for general comparison only. We do not claim expertise in, or authority over, any non-Microsoft product or service; the respective vendor's official documentation is the authoritative source for their offerings, which may change over time. Nothing here is intended to disparage any vendor — where a competing product has genuine advantages, we aim to note them honestly. Verify all third-party details against the vendor's current official documentation before making decisions.
Captured 2026-05-26 by catalog agent
a8260c3697beb6c69from Fabric documentation +casino-fabric-pocworkspace inspection. No existing Eventstream in workspace, so spec is from Fabric docs + sample exploration.
Fabric UX¶
Visual designer canvas¶
Three-section layout: ribbon/canvas + configuration pane (right) + test result pane (bottom). Drag-and-drop nodes connect source → transform → destination. Real-time preview + authoring error validation.
Source picker — types¶
External streaming: Azure Event Hubs · Kafka (Confluent / Apache / Amazon MSK) · Azure IoT Hub · Azure Event Grid · Azure Service Bus · Google Cloud Pub/Sub · Amazon Kinesis Data Streams · MQTT · Solace PubSub+ · Cribl
Change Data Capture (CDC): Azure SQL Database · PostgreSQL · MySQL · Azure Cosmos DB · SQL Server on VM · Azure SQL Managed Instance · MongoDB
Fabric: Workspace item events · OneLake events · Job events · Capacity overview events
Data sources: Azure Blob Storage events · Azure Data Explorer · Real-time weather · Sample data (Bicycles / Yellow Taxi / Stock Market / Buses / S&P 500 / Semantic Model Logs)
Custom: Custom endpoint (HTTP / custom app with connection string)
Transform nodes (event processor operations)¶
Filter · Aggregate (sum/min/max/avg over time windows) · Group by (window-based aggregations) · Manage fields (add/remove/rename/change type) · Join · Union · Expand (array → rows) · SQL operator (preview)
Destination picker¶
Lakehouse (Delta) · Eventhouse (direct or processed ingestion modes) · Activator (intelligent alerting) · Custom endpoint · Derived stream (intermediate) · Spark Notebook (preview, Spark Structured Streaming)
Additional features¶
- Apache Kafka endpoint for native client integration
- Schema management with Fabric Schema Registry
- DeltaFlow (analytics-ready CDC streams)
- Pause/resume controls for derived streams
- Workspace Private Link support
What Loom needs¶
| Component | Status | Loom build target |
|---|---|---|
| Visual canvas | ✅ built | Eventstream React Flow canvas (source → transform → destination nodes) |
| Source picker | Event Hubs source deployable | Event Hubs namespace now shipped (event-hubs-namespace item); Cosmos CDC / ADX / Blob Storage event registrations still incremental |
| Transform nodes | partial (Cosmos persistence) | Implement Filter/Aggregate/GroupBy/Join/Union via Azure Stream Analytics OR Kusto inline ingestion mappings |
| Destination Lakehouse | ❌ | Wire to existing Loom Lakehouse (writes Delta to ADLS) |
| Destination Eventhouse | partial | Wire to existing Loom ADX (Eventhouse equivalent) |
| Destination Activator | ❌ | Wire to existing loom-activator-engine container app |
Backend mapping¶
- Event Hubs for streaming ingress — now deployed via
platform/fiab/bicep/modules/landing-zone/eventhubs.bicep(Microsoft.EventHub/namespaces) and managed in the console as theevent-hubs-namespaceitem (commite1f2aab2; parity docparity/event-hubs-namespace.md). A companion Service Bus namespace (servicebus.bicep/service-bus-namespaceitem) and Event Grid topic (eventgrid.bicep/event-grid-topicitem) shipped in the same wave. - Azure Stream Analytics OR ADX inline ingestion mappings for transforms
- ADX
.ingestcommands when destination is Eventhouse - Loom Activator engine container (already deployed) for Activator destination
Required Azure resources¶
- Event Hubs namespace + hub — shipped (
landing-zone/eventhubs.bicep; theevent-hubs-namespaceconsole item). Grant the Console UAMI Azure Event Hubs Data Owner for Send/receive. - Azure Stream Analytics job — optional (only if not using the ADX-only transform path); still to wire for the full no-code transform surface.
- Kusto ingestion mapping resources — created per-eventstream at run time against the existing ADX cluster.
Estimated effort¶
3-4 sessions. Stream designer alone is 1-2 sessions of UI work. Backend wiring + bicep is another. Then per-source + per-destination wiring is incremental.