Series 10 parts
Spark Pills
A series for data engineers who can run PySpark jobs but want to understand what happens underneath: MapReduce, the DAG, shuffle, joins, skew, caching, the Spark UI, Iceberg, and streaming.
Articles Archive
Articles & Code Tutorials
Guides and notes on Data Engineering, Spark, Iceberg, Python, and more.
Data Engineering SparkAWS
Aug 1, 2026 Spark Performance Tuning: Diagnosing Slow Jobs in Production
Real-world guide to diagnosing and fixing slow Spark jobs on AWS Glue: understanding partitioning, skew, shuffle, and Iceberg compaction strategies.
Data Science Data SciencePython
Apr 6, 2021 Data Science Exercise: Prediction Models with Python
Data exploration and ML classification models comparison to predict whether a person earns more than $50,000/year using Python, Pandas, and Scikit-Learn.
Data Science RRStudio
Apr 4, 2021 Data Science with RStudio: Supervised Learning & Election Prediction
A Supervised Learning exercise using RStudio and Caret package to predict voting patterns in British elections.
Programming CC Language
Apr 2, 2021 Basic Introduction to C: Structs, Pointers and Dynamic Memory
Mastering C core properties: structs, pointers, memory addresses, stack vs heap, and dynamic memory allocation with malloc and free.
Programming CC Language
Apr 1, 2021 Introduction to C Language: Syntax, Variables, Control Flow & Functions
A comprehensive introduction to C programming fundamentals: main function, variables, standard I/O, control flow, loops, and functions.