Skip to main content

Orchestration and Jobs

You'll learn how to create and schedule a Lakeflow Job using the Databricks Workspace in ~10 min.

Prereqs: Build the first ETL pipeline

The big picture​

A scheduled Lakeflow Job running in your workspace, built entirely in the browser. You add the tasks, wire up their order, set a schedule, and watch it run, with no config files to write. Start here before moving to DABs for production.

How it works​

The Jobs page in the Workspace is where you build workflows visually. You add tasks (notebooks, pipelines, SQL), set the order they run in, attach a schedule, and configure retries and notifications.

Video walkthrough​

When to use / when not to​

Build here when you are setting up your first job and want to see it run quickly, when you need an ad-hoc or one-off workflow, or when you want to prototype a task graph before writing it as code.

Switch to DABs when the job has to be version-controlled and deployed across environments, or when you want the pipelines, schemas, and compute defined alongside the job.

Next​