Skip to content

DataForGeeks

for Data Enthusiasts

  • Home
  • Newsletter
  • About

adaptive query execution

It Ran in 10 Minutes Yesterday: How to Debug a Slow Spark Job and Fix Data Skew

September 29, 2026January 28, 2026 by Nikhil Aggarwal

Spark job suddenly slow? Learn to find data skew in the Spark UI and fix it with AQE, broadcast joins and salting. Real screenshots and interview answers.

Categories Apache Spark Tags adaptive query execution, salting, spark data skew, spark performance tuning, spark ui

Follow Me on LinkedIn

Connect Now

Connect with:

Subscribe to our newsletter!

RSS feed: Latest Posts Latest Posts

  • Is Spark Overkill for Most Pipelines? The Rise of DuckDB and Polars October 22, 2026
  • AI Agent Platform vs Data Platform: What Is Different, What Is Merging October 13, 2026
  • LoRA Fine-Tuning Explained: The Intuition, the Math and the Practice September 29, 2026
  • Iceberg Hilbert Curve vs Z-Order: Explained Square by Square September 27, 2026
  • Herdr + Hunk: How to Run and Review Multiple AI Coding Agents in Your Terminal (2026 Guide) September 23, 2026

Categories

  • AI & Machine Learning (2)
  • Apache Spark (4)
  • Data Engineering Essentials (5)
  • Data Lakehouse (3)
  • General (5)
  • Hadoop & Big Data (9)
  • Python (2)
  • Snowflake (2)
  • SQL Interview Questions (15)
  • System Design (2)

Archives

  • October 2026 (2)
  • September 2026 (3)
  • January 2026 (1)
  • November 2025 (1)
  • September 2025 (1)
  • May 2025 (2)
  • January 2025 (1)
  • October 2024 (1)
  • May 2024 (1)
  • September 2023 (1)
  • May 2022 (2)
  • March 2022 (1)
  • February 2022 (1)
  • May 2020 (1)
  • November 2019 (1)
  • July 2019 (1)
  • May 2019 (1)
  • March 2019 (1)
  • December 2018 (2)
  • August 2018 (2)
  • July 2018 (2)
  • June 2018 (1)
  • May 2018 (2)
  • April 2018 (1)
  • March 2018 (2)
  • July 2016 (4)
  • June 2016 (3)
  • June 2015 (2)
  • October 2011 (3)
  • November 2009 (2)
© 2026 DataForGeeks · About · RSS