DP-750 · 4.1.5 · Deploy and maintain data pipelines and workloads
Notebook task pipeline
Create a data pipeline by using a notebook, including precedence constraints
Build notebook-based workflows as Lakeflow Jobs tasks with explicit dependencies and conditional precedence.
Precedence lives in the job graph
Notebook position in a workspace folder does not define execution order. Lakeflow Job task dependencies do.
Make required order explicit
- 1Ingest notebookProduces raw data
- 2Transform notebookDepends on ingest
- 3Validate notebookDepends on transform
- 4Publish notebookDepends on validation
A downstream notebook should depend only on the task whose output it requires.
Keep independent work parallel
- Task needs upstream outputYes
- Tasks are independentNo, run in parallel
Use Run if conditions for workflow routing instead of hiding orchestration branches inside notebook code.
Key points
- Notebook task: Runs a notebook as one job task
- Depends on: Defines upstream precedence
- Parallel branch: Omit dependencies between independent tasks
- Condition: Use status or value branches when flow is not linear
Exam trap
Notebook position in a workspace folder does not define execution precedence.
Sources · 2 Microsoft Learn pages Show ▾
Checked on October 4, 2026. Report a problem
Go deeper on Microsoft Learn
Checked against Microsoft Learn on October 4, 2026. Report a problem with this card