Grouping by the Computed Island Key

Concepts covered: sqlLagLead

The closing escalation at this level covers three areas: performance on large tables, edge cases that ship to production, and the synthesis that ties the two canonical forms together. Hitting all three is what flips the verdict from hire to strong hire on this question. Performance: partition shuffles dominate Both canonical forms partition by the entity column (user_id, subscription_id) and order within the partition. The dominant cost on a distributed engine is the shuffle that co-locates each entity's rows on a single worker. The window functions themselves are cheap once the data is co-located. The optimization lever is to align the source table's clustering or partitioning with the query's partition key. If user_id is the partition column for the sessionization query, cluster the even

About This Interactive Section

This section is part of the Gaps and Islands: Intermediate lesson on DataDriven, a free data engineering interview prep platform. Each section includes explanations, worked examples, and hands-on code challenges that execute in real time. SQL queries run against a live database. Python runs in a sandboxed Docker container. Data modeling problems validate against interactive schema canvases. All content is framed around what data engineering interviewers actually test at companies like Meta, Google, Amazon, Netflix, Stripe, and Databricks.

How DataDriven Lessons Work

DataDriven combines four interview rounds (SQL, Python, Data Modeling, Pipeline Architecture) with adaptive difficulty and spaced repetition. Easy problems get harder as you improve. Weak concepts resurface until you master them. Your readiness score tracks progress across every topic interviewers test. Every lesson section ends with problems you solve by writing and running real code, not by picking multiple-choice answers.