Best Practices¶
Proven patterns, architectural guidance, and operational best practices for production Microsoft Fabric deployments.
Workspace & Infrastructure¶
-
Workspaces & Naming
Naming conventions, workspace organization, and environment structure.
-
Data Gateway
On-premises data gateway setup, configuration, and management.
-
Lakehouse Setup
Lakehouse architecture, schema design, and optimization patterns.
-
Warehouse Setup
Data Warehouse configuration, loading patterns, and query tuning.
Data Movement & Processing¶
-
Pipelines & Data Movement
Pipeline design, Copy Activity optimization, and data movement patterns.
-
Metadata-Driven Pipelines
Dynamic, configuration-driven pipelines for scalable data ingestion.
-
Spark & Notebooks
PySpark optimization, notebook best practices, and Spark configuration.
-
Dataflows Gen2
Power Query dataflow patterns for low-code transformations.
-
Incremental Refresh & CDC
Change data capture and incremental refresh patterns for efficiency.
-
ETL/ELT Comparison
When to use ETL vs ELT approaches in Fabric workloads.
Source Systems & Migration¶
-
Oracle & SQL Server Patterns
Source-specific ingestion patterns for Oracle and SQL Server.
-
Oracle Gateway Troubleshooting
Common Oracle gateway issues, diagnostics, and resolution steps.
-
Migration Patterns
Strategies for migrating from legacy platforms to Microsoft Fabric.
-
Spark Runtime Migration
Upgrade path and breaking changes for Spark Runtime 2.0.
Architecture & Design¶
-
Decision Guide
Choosing between Fabric compute engines, storage layers, and patterns.
-
Medallion Architecture Deep Dive
Bronze, Silver, Gold layer patterns with implementation details.
-
Lakehouse vs Warehouse vs SQL DB
When to choose Lakehouse, Warehouse, or SQL Database in Fabric.
-
Data Modeling & Star Schema
Dimensional modeling, star schema design, and semantic layer patterns.
-
Multi-Tenant Architecture
Workspace isolation, tenant management, and multi-org patterns.
Security & Governance¶
-
Data Governance Deep Dive
Purview integration, lineage, classification, and governance policies.
-
Identity & RBAC Patterns
Role-based access control, workspace roles, and identity management.
-
Network Security
Private endpoints, managed VNets, and network isolation patterns.
-
Customer-Managed Keys
CMK encryption for data-at-rest with Azure Key Vault integration.
-
Outbound Access Protection
Control and monitor outbound network traffic from Fabric workspaces.
-
SQL Audit Logs Compliance
SQL audit logging for regulatory compliance and forensic analysis.
Operations & Monitoring¶
-
Error Handling & Monitoring
Error handling patterns, retry logic, and monitoring setup.
-
Alerting & Data Activator
Proactive alerting with Data Activator and Azure Monitor integration.
-
Performance & Parallelism
Query optimization, parallel processing, and performance tuning.
-
Monitoring & Observability
End-to-end observability with metrics, logs, and dashboards.
-
CI/CD with fabric-cicd
Continuous integration and deployment for Fabric items.
-
Testing Strategies
Unit, integration, and end-to-end testing for Fabric workloads.
Cost & Capacity¶
-
Capacity Planning & Cost
SKU sizing, CU consumption analysis, and capacity optimization.
-
FinOps & Cost Governance
Financial operations framework for Fabric cost management.
-
Disaster Recovery & BCDR
Business continuity, disaster recovery, and geo-redundancy patterns.
Analytics & BI¶
-
Power BI Best Practices
Report design, DAX optimization, and semantic model patterns.
-
Data Sharing & Federation
Cross-workspace sharing, external data sharing, and federation patterns.