via “lakeflow orchestration for batch and streaming etl pipelines”
Unified analytics and AI platform — lakehouse, MLflow, Model Serving, Mosaic AI, Unity Catalog.
Unique: Databricks Lakeflow provides native workflow orchestration tightly integrated with Delta Lake and Unity Catalog, enabling automatic data lineage tracking and governance without requiring separate orchestration infrastructure. Unlike Airflow, Lakeflow abstracts cluster management and provides built-in integration with Databricks compute and data governance.
vs others: Simpler than Airflow for Databricks-only workloads (no separate infrastructure), tighter data governance integration than Airflow (automatic lineage via Unity Catalog), and cheaper than managed Airflow services for variable workloads (per-run billing vs. per-instance-hour).