I'm a Data Engineer working with Spark, Apache Iceberg, and dbt on AWS. I maintain a SaaS production Lakehouse platform with dozens of Glue jobs and write about real-world engineering problems on Medium.
Real-world production engineering challenges and Lakehouse insights
Building a Semantic Layer from Zero (Part 2): Can Column Descriptions Alone Stop an LLM From Hallucinating SQL? Same 6 questions, same database — but this time the model gets the schema. 6/6 correc...
6 questions, 12 attempts, 1 silent fabrication that would have gone straight into a report This is part 1 of a 6-post series that answers one question: How much context does a model actually need t...
8 architecture decisions, 5 Debezium incidents, 3 corrections — and what a streaming pricing engine looks like after all of them The entire project was built with spec-driven development — every ph...
Data Science exercises, ML algorithms & C programming notes
Real-world guide to diagnosing and fixing slow Spark jobs on AWS Glue: understanding partitioning, skew, shuffle, and Iceberg compaction strategies.
Data exploration and ML classification models comparison to predict whether a person earns more than $50,000/year using Python, Pandas, and Scikit-Learn.
A Supervised Learning exercise using RStudio and Caret package to predict voting patterns in British elections.