Normalizing Inconsistent Text Values

Concepts covered: sqlRegexMatch

Production logs and exports use formats that are structured but not JSON: pipe-delimited columns, key=value pairs, NDJSON (newline-delimited JSON). Parsing them is a composition of SPLIT, REGEXP_EXTRACT, and the JSON tools from the semi-structured lesson. Pipe-delimited logs Reading the pattern SPLIT_PART for the timestamp because it's the first piece. REGEXP_EXTRACT for the key=value pairs because each one is a structured but variable-position match. Cast the amount to NUMERIC because the extraction returns text. The pattern composes the basic tools into a parser; the result is structured columns ready for downstream queries. NDJSON files NDJSON is one JSON object per line. The 'parsing' is just splitting on newlines and then applying the JSON extraction tools from the semi-structured les

About This Interactive Section

This section is part of the String Manipulation: Intermediate lesson on DataDriven, a free data engineering interview prep platform. Each section includes explanations, worked examples, and hands-on code challenges that execute in real time. SQL queries run against a live database. Python runs in a sandboxed Docker container. Data modeling problems validate against interactive schema canvases. All content is framed around what data engineering interviewers actually test at companies like Meta, Google, Amazon, Netflix, Stripe, and Databricks.

How DataDriven Lessons Work

DataDriven combines four interview rounds (SQL, Python, Data Modeling, Pipeline Architecture) with adaptive difficulty and spaced repetition. Easy problems get harder as you improve. Weak concepts resurface until you master them. Your readiness score tracks progress across every topic interviewers test. Every lesson section ends with problems you solve by writing and running real code, not by picking multiple-choice answers.