Create ingestion pipeline

info

• Before creating the ingestion pipeline, get familiar with Managed connectors in Lakeflow Connect. .
• Ingestion pipelines require a connection (covered in the last section).

warning

Mar 1st, 2026 - The UI ingestion pipeline creation is full serverless. If classic compute is required for network reasons, the pipeline must be deployed through Databricks Asset Bundles (DABs subsection).

• Database connector components.
  • Ingestion gateway (pipeline): Requires classic compute in your organization VPC dedicated for Databricks. Moves the data to staging storage.
  • Ingestion pipeline (pipeline): Can be serverless because it can access the UC default storage out-of-the-box.

Youtube tutorials

Lakeflow Connect showcase

---

SQL Server | Change Data Capture (CDC)

---

Salesforce

---

SharePoint

---

ServiceNow

In this section:

• DABs definition – Define and deploy ingestion pipelines using Databricks Asset Bundles