Discussion · Python

wrote a tutorial on PySpark joins for DE interviews

wrote a tutorial on PySpark joins for DE interviews

smart_haven_7600·

just dropped a video on PySpark joins - broadcast vs sort-merge, when each one makes sense, data skew and how to spot it before it kills your job. if you have a spark-heavy interview coming up it might help. link in bio or just search it

60

5 comments

Would it be possible to share the youtube channel name please

73

Buddy would it possible to share the channel name, will definitely have a look. I am browsing through website and not getting any option to check the bio

65

salting vs repartition - which comes up more in interviews

24

wait what's salting in this context

18

salting, probably. repartition you can figure out in the moment. explaining why you'd salt a key takes actual understanding

16

Elsewhere in Python

All Python threads