04A Spark job that used to finish in minutes now takes hours. How do you diagnose and fix it?▼hardDatabricksSnowflakeMicrosoft2 repliesunlockedThe Databricks-flavored performance question. The signal is going straight to the usual suspects (skew, shuffle, spill) via the Spark UI, not guessing. Here is the diagnostic order and the fixes that actually move the needle.Open full answer →
23What is data skew in a distributed job (Spark), and how do you fix it?▼hardDatabricksAmazonMeta1 replies◆ premiumThe top cause of mysteriously slow Spark jobs: one partition does most of the work while the rest idle. The signal is reading the symptom (a few straggler tasks) and reaching for the right fix, salting, broadcast, or AQE.Open full answer →
