Cloudera to Azure Migration Center¶
Comparative positioning note
This document is written from the perspective of Microsoft Azure, Cloud Scale Analytics, and CSA Loom. Any description of third-party or competing products, services, pricing, or capabilities is derived from publicly available documentation and sources believed accurate at the time of writing, and is provided for general comparison only. We do not claim expertise in, or authority over, any non-Microsoft product or service; the respective vendor's official documentation is the authoritative source for their offerings, which may change over time. Nothing here is intended to disparage any vendor — where a competing product has genuine advantages, we aim to note them honestly. Verify all third-party details against the vendor's current official documentation before making decisions.
The definitive resource for migrating from Cloudera CDH/CDP to Microsoft Azure, Databricks, and CSA-in-a-Box.
Who this is for¶
This migration center serves CDOs, data platform architects, data engineers, Hadoop administrators, and analytics leaders who are evaluating or executing a migration from Cloudera CDH 6.x, CDP Private Cloud, or CDP Public Cloud to Azure-native services. Whether you are responding to CDH end-of-life, escalating CDP renewal costs, or a strategic pivot toward cloud-native analytics, these resources provide the evidence, patterns, and step-by-step guidance to execute confidently.
Quick-start decision matrix¶
| Your situation | Start here |
|---|---|
| Executive evaluating Azure vs Cloudera | Why Azure over Cloudera |
| Need cost justification for migration | Total Cost of Ownership Analysis |
| Need a feature-by-feature comparison | Complete Feature Mapping |
| Ready to plan a migration | Migration Playbook |
| Running Impala workloads | Impala Migration Guide |
| Running NiFi data flows | NiFi Migration Guide |
| Using CDP Data Engineering / CML | CDP Data Engineering Guide |
| Want hands-on tutorials | Tutorials |
| Need performance data | Benchmarks |
| Need migration best practices | Best Practices |
Strategic resources¶
These documents provide the business case, cost analysis, and strategic framing for decision-makers.
| Document | Audience | Description |
|---|---|---|
| Why Azure over Cloudera | CIO / CDO / Board | Executive brief covering CDH end-of-life urgency, managed-service advantages, talent availability, AI/ML capabilities, and honest assessment of Cloudera strengths |
| Total Cost of Ownership Analysis | CFO / CIO / Procurement | Detailed pricing model comparison across CDH on-prem, CDP Private Cloud, and CDP Public Cloud vs Azure consumption model, with 5-year projections |
| Benchmarks & Performance | CTO / Platform Engineering | Spark performance, Impala vs Databricks SQL, NiFi vs ADF throughput, cost efficiency, and operational overhead comparisons |
Technical references¶
| Document | Description |
|---|---|
| Complete Feature Mapping | 40+ Cloudera components mapped to Azure equivalents with migration complexity ratings, from HDFS and Hive through NiFi, Ranger, Atlas, CML, and CDE |
| Migration Playbook | The original end-to-end migration playbook with component mapping, phased plan, HDFS/Hive/Spark/Oozie migration, security conversion, and validation framework |
Component migration guides¶
Domain-specific deep dives covering the components that require specialized migration approaches beyond the core playbook.
| Guide | Cloudera component | Azure destination |
|---|---|---|
| Impala Migration | Impala, Kudu | Databricks SQL, Delta Lake, Fabric SQL endpoint |
| NiFi Migration | Apache NiFi, NiFi Registry | Azure Data Factory, Logic Apps, ADF Git integration |
| CDP Data Engineering | CDE, CML, CDP Data Warehouse | Databricks, Azure ML, Databricks SQL, Fabric |
Tutorials¶
Hands-on, step-by-step walkthroughs for common migration scenarios.
| Tutorial | Duration | What you will build |
|---|---|---|
| NiFi Flow to ADF Pipeline | 2-3 hours | Convert a NiFi data ingestion flow to an ADF pipeline with equivalent processors, error handling, and scheduling |
| Impala Workload to Databricks SQL | 2-3 hours | Migrate an Impala analytical workload to Databricks SQL with SQL conversion, Kudu-to-Delta conversion, and performance validation |
Best practices & planning¶
| Document | Description |
|---|---|
| Best Practices | Cluster-by-cluster migration strategy, CDP vs CDH differences, service decomposition, parallel-run patterns, decommission timelines, and team structure |
How CSA-in-a-Box fits¶
CSA-in-a-Box is the core migration destination -- an Azure-native reference implementation providing Data Mesh, Data Fabric, and Data Lakehouse capabilities. For Cloudera migrations specifically, it provides:
- ADLS Gen2 + OneLake replacing HDFS with medallion architecture (bronze/silver/gold)
- Databricks + dbt replacing Hive, Spark on YARN, and Impala
- Azure Data Factory replacing Oozie, Sqoop, NiFi, and Flume
- Event Hubs replacing Kafka with wire-protocol compatibility
- Purview + Unity Catalog replacing Ranger and Atlas
- Azure Monitor replacing Cloudera Manager health checks
- Infrastructure as Code (Bicep across 4 Azure subscriptions)
Migration timeline overview¶
gantt
title Typical Cloudera-to-Azure Migration (30 weeks)
dateFormat YYYY-MM-DD
section Phase 1 -- Assessment
Cluster inventory & profiling :a1, 2026-05-04, 3w
Dependency mapping & TCO estimate :a2, after a1, 2w
section Phase 2 -- Infrastructure
Azure landing zone & ADLS Gen2 :a3, after a2, 3w
Databricks + Unity Catalog deploy :a4, after a2, 3w
Purview + Event Hubs + ADF setup :a5, after a3, 2w
section Phase 3 -- Data Migration
HDFS to ADLS (Data Box / WANdisco) :a6, after a4, 4w
Hive schema + Delta conversion :a7, after a6, 2w
section Phase 4 -- Workloads
Spark jobs to Databricks :a8, after a7, 4w
Hive SQL to dbt + Impala migration :a9, after a7, 4w
Oozie/NiFi to ADF pipelines :a10, after a7, 4w
Kafka to Event Hubs :a11, after a7, 2w
section Phase 5 -- Validation
Parallel run (2+ weeks) :a12, after a8, 3w
Performance benchmarking :a13, after a12, 1w
Cutover & CDH decommission :a14, after a13, 2w Cross-references¶
| Topic | Document |
|---|---|
| ADR: Databricks over OSS Spark | docs/adr/0002-databricks-over-oss-spark.md |
| ADR: Delta Lake over Iceberg and Parquet | docs/adr/0003-delta-lake-over-iceberg-and-parquet.md |
| ADR: Event Hubs over Kafka | docs/adr/0005-event-hubs-over-kafka.md |
| ADR: Purview over Atlas | docs/adr/0006-purview-over-atlas.md |
| ADR: ADF + dbt over Airflow | docs/adr/0001-adf-dbt-over-airflow.md |
| AWS to Azure migration | docs/migrations/aws-to-azure.md |
| GCP to Azure migration | docs/migrations/gcp-to-azure.md |
| Hadoop/Hive migration | docs/migrations/hadoop-hive.md |
| OSS migration playbook | docs/guides/oss-migration-playbook.md |
Last updated: 2026-04-30 Maintainers: CSA-in-a-Box core team