Explanation:
In a fan-out pattern, multiple downstream tasks can depend on the same upstream task. Once the source completes, the independent downstream tasks execute in parallel, improving efficiency for parallel processing workloads.
You are designing a Lakeflow Job that follows a fan-out pattern: A single source task prepares data. Multiple downstream tasks perform independent processing on that same output. How do the downstream tasks typically execute relative to the source task?
A
They run in parallel after the source task completes, each depending on the same upstream task
B
They must be combined into a single task to avoid duplication
C
They run before the source task to precompute results
D
They run sequentially, one after another, after the source task completes
No comments yet.