Discussion · Python

wrote a tutorial on PySpark joins for DE interviews

wrote a tutorial on PySpark joins for DE interviews

smart_haven_7600·

just dropped a video on PySpark joins - broadcast vs sort-merge, when each one makes sense, data skew and how to spot it before it kills your job. if you have a spark-heavy interview coming up it might help. link in bio or just search it

60

5 comments

salting vs repartition - which comes up more in interviews

24

salting, probably. repartition you can figure out in the moment. explaining why you'd salt a key takes actual understanding

16

wait what's salting in this context

18

Buddy would it possible to share the channel name, will definitely have a look. I am browsing through website and not getting any option to check the bio

65

Would it be possible to share the youtube channel name please

73

Elsewhere in Python

All Python threads