How does Spark manage memory on executors? What happens when a Spark job runs out of memory, and how do you troubleshoot it?

Sample answer preview

Understanding Spark memory management is crucial for tuning jobs and diagnosing failures. Memory issues are among the most common problems in production Spark applications. Spark divides executor memory into several regions.