A task-based Airflow deployment runs two tasks in sequence: compute_fct_orders writes fct_orders, co
A medium Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- medium
Interview Prompt
A task-based Airflow deployment runs two tasks in sequence: compute_fct_orders writes fct_orders, compute_mart_revenue reads fct_orders and writes mart_revenue. The data dependency is in the engineer's head; the orchestrator does not know which tables each task touches. Apply the asset-vs-task framing this section just taught and add the asset-aware lineage layer. The structural footprint is a catalog node (DataHub, Atlan, Collibra, Marquez, or OpenLineage) that records which task produces which asset; the catalog turns implicit code-level lineage into orchestrator-queryable metadata. Replace the plain Snowflake mart with a lakehouse format (Iceberg, Delta, or Hudi) so the assets carry snapshot identity that the catalog can track. The deployment becomes hybrid: tasks still execute the work, but the catalog + lakehouse seam expose lineage at the asset level.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision