Blog

Articles on Apache Airflow, AI agents, workflow orchestration, and modern data engineering on GCP, AWS and Azure.

Recent

Claude Code Subagents: Delegate Tasks, Keep Your Context Clean

How Claude Code subagents work, how to create them, and real examples — code review, test analysis, batch migrations — with context isolation that keeps long sessions fast.

claudeaiagents
Claude Code Subagents: Delegate Tasks, Keep Your Context Clean

How Claude Actually Works — Architecture Deep Dive

From token IDs to streamed responses: a technical walkthrough of Claude's request lifecycle, transformer inference, prompt caching, and tool use.

claudeaillm
How Claude Actually Works — Architecture Deep Dive

The Right Way to Think About AI Collaboration

AI doesn't remove thinking — it removes the first 60% of effort. Here's what responsible AI collaboration actually looks like in data engineering.

aiproductivitydata-engineering
The Right Way to Think About AI Collaboration

Apache Airflow

Apache Airflow Architecture Simplified

Apache Airflow architecture explained: Web Server, Scheduler, Executor types, Workers, Metadata DB, and Message Broker — how DAGs and microservices collaborate to orchestrate data workflows at scale.

airflowdata-engineeringarchitecture
Apache Airflow Architecture Simplified

Handbook for Becoming an Astronomer Champion for Apache Airflow

How to become an Astronomer Champion — my Apache Airflow journey from building a customer data platform (CDP) in 2019 to earning the Airflow Fundamentals certification and getting selected as an Airflow advocate.

airflowcareercertification
Handbook for Becoming an Astronomer Champion for Apache Airflow

Solving Data Pipeline Challenges with Apache Airflow: A Real-Life Example

Real-world migration from Talend ETL to Apache Airflow for a customer data platform (CDP) processing 800M+ records — use cases, DAG design, pros and cons, and lessons from production pipelines.

airflowdata-engineeringetl
Solving Data Pipeline Challenges with Apache Airflow: A Real-Life Example

Airflow Installation Simplified — using Docker Compose / Podman Compose

Step-by-step guide to install Apache Airflow locally using Docker Compose or Podman Compose — includes docker-compose.yml setup, environment config, and running the Airflow UI in minutes.

airflowdockerdevops
Airflow Installation Simplified — using Docker Compose / Podman Compose

AI & Developer Tools

Claude Code Subagents: Delegate Tasks, Keep Your Context Clean

How Claude Code subagents work, how to create them, and real examples — code review, test analysis, batch migrations — with context isolation that keeps long sessions fast.

claudeaiagents
Claude Code Subagents: Delegate Tasks, Keep Your Context Clean

How Claude Actually Works — Architecture Deep Dive

From token IDs to streamed responses: a technical walkthrough of Claude's request lifecycle, transformer inference, prompt caching, and tool use.

claudeaillm
How Claude Actually Works — Architecture Deep Dive

The Right Way to Think About AI Collaboration

AI doesn't remove thinking — it removes the first 60% of effort. Here's what responsible AI collaboration actually looks like in data engineering.

aiproductivitydata-engineering
The Right Way to Think About AI Collaboration

Claude 101 — How to Actually Get Good Answers

Most Claude prompts fail for the same reason: too vague. Here's how to prompt Claude the right way — with real before/after examples from a data engineer.

aiclaudeproductivity
Claude 101 — How to Actually Get Good Answers

What is Claude AI? Honest Review After Using It for Real Work

I used Claude AI for real projects — building this site, analyzing docs, writing code. My honest take on what it does well and where it still falls short.

aiclaudetools
What is Claude AI? Honest Review After Using It for Real Work

7 Skills to Master AI in 2026

Most developers use AI like a search engine. Here's the playbook to use it like a force multiplier — seven skills that separate people who get results from people who get frustrated.

aiproductivitydeveloper-tools
7 Skills to Master AI in 2026

How to Get Better AI Code Suggestions: Fix Your Repo, Not the Model

Bad AI code suggestions? It's usually not the model — it's your repo. Here's what to change to make Copilot, Cursor, and Claude actually useful across any stack.

aideveloper-toolsgithub-copilot
How to Get Better AI Code Suggestions: Fix Your Repo, Not the Model

From Prompt Engineering to Orchestrating AI Agents

A developer's journey from replacing Stack Overflow with ChatGPT to orchestrating multi-agent systems with MCP servers — how AI changed the way we actually build software.

aiagentsprompt-engineering
From Prompt Engineering to Orchestrating AI Agents

Career & Community

Handbook for Becoming an Astronomer Champion for Apache Airflow

How to become an Astronomer Champion — my Apache Airflow journey from building a customer data platform (CDP) in 2019 to earning the Airflow Fundamentals certification and getting selected as an Airflow advocate.

airflowcareercertification
Handbook for Becoming an Astronomer Champion for Apache Airflow