Given a dataset in SQL, convert it to PySpark and then: (1) filter out records where data is missing or null, (2) extract the top 5 users with the highest activity count per day.
Schema: activity table with user_id, activity_date, activity_count (or equivalent). The conversion tests ability to translate SQL GROUP BY + HAVING + window logic into PySpark DataFrame API. Key PySpark operations: df.filter(df.column.isNull()), df.groupBy().agg(F.sum()), Window.partitionBy(date).orderBy(count.desc()), df.filter(rank <= 5). Tests PySpark proficiency, null handling, and window function knowledge in Spark context. From Microsoft Data Engineer interview guide.