Subham Khandelwal – Medium

Subham Khandelwal

he

Pinned

Subham Khandelwal

Apache Spark Interview Series — Test your Knowledge 🧠

Questions on Apache Spark to test your ability for Interviews and knowledge on Spark background

Mar 17

Apache Spark Interview Series — Test your Knowledge 🧠

Mar 17

Pinned

Subham Khandelwal

LearnBigData101 — Spark Series

Series follows learning Apache Spark from Scratch with Python. Click on the links below to learn more.

Oct 1, 2022

LearnBigData101 — Spark Series

Oct 1, 2022

Subham Khandelwal

PySpark — Spark Streaming Error and Exception Handling

Understand How to handle Spark Streaming Errors and Exceptions

Mar 20

PySpark — Spark Streaming Error and Exception Handling

Mar 20

Subham Khandelwal
in
Dev Genius

PySpark — Spark Streaming Checkpoint Directory

Understand the use of different folders and contents inside Spark Streaming Checkpoint Directory

Feb 26

PySpark — Spark Streaming Checkpoint Directory

Feb 26

Subham Khandelwal
in
Dev Genius

PySpark — Dynamic Resource Allocation in Spark

Configure Dynamic Resource Allocation using PySpark for proper resource utilization

Jan 7

PySpark — Dynamic Resource Allocation in Spark

Jan 7

Subham Khandelwal
in
Dev Genius

PySpark — Optimize Joins in Spark

Shuffle Hash Join, Sort Merge Join, Broadcast joins and Bucketing for better Join Performance.

Dec 30, 2023

PySpark — Optimize Joins in Spark

Dec 30, 2023

Subham Khandelwal

PySpark — DAG & Explain Plans

Understand How Spark divides Jobs into Stages and Tasks?

Nov 19, 2023

PySpark — DAG & Explain Plans

Nov 19, 2023

Subham Khandelwal
in
Dev Genius

PySpark — Unit Test Cases using PyTest

Understand how to write unit test cases for PySpark using PyTest module.

Sep 30, 2023

PySpark — Unit Test Cases using PyTest

Sep 30, 2023

Subham Khandelwal

PySpark — Optimize Parquet Files

Understand How Parquet files can be compacted efficiently utilizing RLE (Run Length Encoding)

Apr 16, 2023

PySpark — Optimize Parquet Files

Apr 16, 2023

Subham Khandelwal
in
Dev Genius

PySpark — Estimate Partition Count for File Read

Understand how Spark estimates the number of Partitions required to read a file

Mar 21, 2023

PySpark — Estimate Partition Count for File Read

Mar 21, 2023

Subham Khandelwal

Subham Khandelwal

he

Solutions Architect @Databricks | YouTube: https://www.youtube.com/@easewithdata | TopMate : https://topmate.io/subham_khandelwal

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams