Environment — workload reference¶
Family: Data Engineering Loom slug:
environmentEditor file:apps/fiab-console/lib/editors/phase2-misc-editors.tsxBFF routes:app/api/items/environment/**Parity spec:fiab/environment-parity-spec.md
Purpose¶
Reusable Spark environment spec: requirements.txt content, JAR paths, and spark.* configuration overrides. Applied to a Synapse Spark pool via Apply to pool, which merges the environment's requirements / conf / jars into the pool's libraryRequirements + sparkConfigProperties + customLibraries and PUTs the result.
Fabric-parity gap¶
| Fabric feature | Loom state |
|---|---|
| Edit requirements / conf / jars | Shipped |
| Apply to pool | Shipped — full ARM PUT |
| Pool selector | Shipped — driven by /api/items/synapse-spark-pool/list |
| Compute hours analytics | Gated — Synapse cost API integration deferred |
Real backend it calls¶
- Cosmos
itemsfor environment spec. - ARM
Microsoft.Synapse/workspaces/.../bigDataPoolsfor the apply operation (synapse-pool-arm.tsfamily of helpers).
Sample usage¶
- Open
/items/environment/<id>. - Paste
pandas==2.1.4\nnumpy==1.26.2into requirements. - Add
{ "spark.executor.memory": "8g" }to conf. - Pick a target pool from the dropdown.
- Save then Apply to pool.
Bicep + env vars¶
| Env | Purpose | Bicep module |
|---|---|---|
LOOM_SYNAPSE_WORKSPACE | Pool target host | landing-zone/synapse.bicep |
LOOM_UAMI_CLIENT_ID | Console UAMI | identity.bicep |