If you've ever built ETL pipelines pulling data from MongoDB into Delta Lake using Spark, you've probably hit this wall. The pipeline works fine — until it doesn't. A single document with an unexpected shape is enough to break the entire write, leave the table in an inconsistent state, and send your on-call engineer digging through Spark logs at 11pm. I built and maintained more than 10 of these j
I was out walking with my dog Dexter, daydreaming on the first properly warm day of the year. I was lost in my own mind mulling over a conversation I'd had with a fellow Game Developer about how we've adapted to the use of AI as software engineers. None of the existing labels fit. "Vibe coding", Karpathy's term, elicits a culture of care-free one-shotting with little to no regard for the code qual
I've been on both sides of the data engineering hiring table for years. I've written interview loops, failed interview loops, and watched candidates ace screens that told me absolutely nothing about whether they could debug a silent data loss bug at 2am. The signal was always thin. Now it's basically noise. Here's the situation in 2026: 64% of companies ban AI in interviews. Candidates use it anyw
Generative AI is no longer just an emerging technology. It is becoming a core business capability across software development, customer support, analytics, content generation, automation, knowledge management, and enterprise productivity. For cloud professionals, developers, data teams, and solution architects, learning Generative AI on AWS is now a high-value career move. AWS provides a growing e
The Model Context Protocol has transformed how we connect AI to tools. But connecting agents to tools is only half the battle — connecting agents to each other is where the real challenge begins. I recently read @raviteja_nekkalapu_'s excellent article "I built an AI security Firewall and made it open source because production apps were leaking SSNs to OpenAI" and it resonated deeply with challeng
When stepping into the world of data engineering, Apache Airflow is likely one of the first tools you will encounter. It is the industry standard for programmatically authoring, scheduling, and monitoring workflows. Before building our first DAG, it's important to know what has changed in Airflow 3.1.0. Initially, Airflow users imported DAGs and tasks from airflow.models and airflow.decorators. I
A deeply-synthesized, opinionated reference distilled from five canonical sources: donnemartin/system-design-primer · ByteByteGoHq/system-design-101 · karanpratapsingh/system-design · ashishps1/awesome-system-design-resources · binhnguyennus/awesome-scalability Use it as: a study guide for interviews, a checklist for design reviews, and a vocabulary for cross-team discussions. 📖 How to Use This
Vendredi matin, 9 h 15. Françoise est dans son cockpit — trois écrans, à gauche l'Excel-pointeuse qu'elle tient à jour depuis quinze ans, à droite Sage, et au milieu Rembrandt depuis trois semaines. Sa tasse à la main, celle avec sa tête imprimée dessus que quelqu'un lui a offerte à Noël. Elle pivote sur sa chaise et me lance depuis son bureau : « Michel, combien on a d'inscrits pour la rentrée, d