This guide maps out the recommended reading order through the Data Architecture series and points you to the best external resources for hands-on learning at each stage. Whether you’re a complete beginner or an experienced engineer filling gaps, there’s a path here for you.
How to Use This Series
The 13 articles in this series are designed to be read in sequence — each builds on the previous. However, if you know your starting level, you can jump in at the right phase:
📍 Navigation Guide
Beginner: Start at Phase 1 — Article 01 (Jargon 101).Know the basics: Start at Phase 2 — Article 04 (Lakehouse).
Senior engineer: Jump to Phase 3 — Articles 09–11 (Patterns, Real-Time, Vectors).
Phase 1: Foundation
Weeks 1–4 · Articles 01–03
Phase 1
Foundation — Learn the Language
Start here to build your vocabulary and understand the two dominant paradigms before diving into modern architectures.
| # | Article | What You’ll Learn |
|---|---|---|
| 01 | Data Jargon 101 | Schema-on-Read/Write, ETL vs ELT, OLAP/OLTP, ACID, Medallion, Data Contracts |
| 02 | Data Lake | Zone architecture (Bronze/Silver/Gold), storage formats, tools, when to choose |
| 03 | Modern Data Warehouse | MPP engines, dimensional modelling, Star Schema, SCD types, Snowflake/BigQuery/Synapse |
| 12 | Business Glossary | Business-user definitions with real examples — share with stakeholders |
🔗 External Resources — Phase 1
| Resource | Why It’s Worth Reading |
|---|---|
| Databricks Glossary | Comprehensive, vendor-neutral definitions of data architecture terms |
| AWS Data Lake Guide | AWS’s practical introduction to data lake concepts |
| Azure Data Architecture Guide | Microsoft’s authoritative reference for cloud data architecture patterns |
| The Data Warehouse Toolkit — Kimball | The foundational book on dimensional modelling — still essential reading |
| Fundamentals of Data Engineering — Reis & Housley | Modern, comprehensive overview of the data engineering lifecycle |
Phase 2: Modern Architectures
Weeks 5–8 · Articles 04–08
Phase 2
Modern Architectures — The Current Landscape
Understand the architectures that have emerged over the last 5 years and how they compare.
| # | Article | What You’ll Learn |
|---|---|---|
| 04 | Data Lakehouse | Open table formats (Delta/Iceberg/Hudi), ACID on object storage, unified analytics |
| 05 | Data Mesh | 4 principles, domain ownership, data as a product, federated governance |
| 06 | Microsoft Fabric | OneLake, 6 workloads, Direct Lake mode, capacity model |
| 07 | Table Formats Deep Dive | Delta Lake internals, Z-Order, Liquid Clustering, Iceberg hidden partitioning, Hudi upserts |
| 08 | Architecture Decision Framework | Comparison matrix, decision flowchart, evolution roadmap, common pitfalls |
🔗 External Resources — Phase 2
| Resource | Why It’s Worth Reading |
|---|---|
| Delta Lake Documentation | Official Delta Lake tutorials — start with the quickstart |
| Apache Iceberg Docs | Comprehensive Iceberg documentation with Java, Python, Spark examples |
| Apache Hudi Documentation | Hudi concepts, quickstart, and CDC guides |
| Databricks Academy — Data Lakehouse Fundamentals | Free course on lakehouse concepts (no Databricks account needed for some modules) |
| Data Mesh Principles — Zhamak Dehghani | The original 2019 article defining Data Mesh — read before anything else on the topic |
| Microsoft Fabric Documentation | Microsoft’s official Fabric learning path — structured by workload |
| Thoughtworks Technology Radar | Quarterly assessment of emerging data technologies — useful for staying current |
Phase 3: Advanced Patterns & Emerging Topics
Weeks 9–12 · Articles 09–11
Phase 3
Advanced Patterns — Production Engineering
Go beyond architecture selection into the implementation patterns and emerging topics that define production-grade data systems.
| # | Article | What You’ll Learn |
|---|---|---|
| 09 | Architecture Patterns | Medallion, Lambda, Kappa, Z-Order, Liquid Clustering, Data Vault |
| 10 | Real-Time Architecture | Kafka internals, Flink event-time processing, CEP, streaming patterns, latency tiers |
| 11 | Unstructured Data & Vectors | Embedding models, RAG architecture, vector databases, chunking strategies |
🔗 External Resources — Phase 3
| Resource | Why It’s Worth Reading |
|---|---|
| Apache Kafka Documentation | Complete Kafka reference — start with the Introduction section |
| Apache Flink Documentation | Flink concepts guide — DataStream API and event-time processing |
| Designing Data-Intensive Applications — Kleppmann | The definitive book on distributed systems for data engineers |
| Streaming Systems — Akidau et al. | Deep dive into event-time processing, watermarks, and window semantics |
| Building RAG Applications — LangChain | Practical RAG tutorial using LangChain with vector stores |
| OpenAI Embeddings Guide | Official guide to text embeddings — best practices for chunking and retrieval |
| Pinecone Learn | Excellent free resources on vector databases and semantic search |
🛠️ Hands-On Learning Environments
Don’t just read — experiment. These free environments let you practice the concepts:
| Environment | What You Can Practice | Free Tier |
|---|---|---|
| Databricks Community Edition | Delta Lake, Spark, MLflow, SQL Warehouse | ✅ Free forever |
| Snowflake Trial | Data Warehouse, Snowpark, data sharing | ✅ 30-day trial |
| Google BigQuery Sandbox | SQL analytics, ML, Iceberg tables | ✅ Free sandbox |
| Microsoft Fabric Trial | All 6 Fabric workloads on a real tenant | ✅ 60-day trial |
| Confluent Cloud | Kafka topics, connectors, ksqlDB | ✅ Free tier (5GB/month) |
| dbt Core | dbt transformations on any warehouse | ✅ Open source |
📺 Recommended Talks & Videos
| Talk | Speaker | Why Watch |
|---|---|---|
| The Rise of the Data Lakehouse | Matei Zaharia (Databricks) | Visionary talk on why Lakehouse emerged |
| Data Mesh in Practice | Zhamak Dehghani (ThoughtWorks) | Original author explains the 4 principles live |
| Apache Iceberg: A Table Format for Huge Analytic Datasets | Ryan Blue (Netflix) | The engineering story behind Iceberg’s design |
| Real-Time Analytics at Scale | Various (Flink Forward) | Production streaming architecture from practitioners |
🎯 Completion Checklist
Use this as a self-assessment after working through the series:
- I can explain Schema-on-Read vs Schema-on-Write and when to use each
- I can describe the Bronze/Silver/Gold Medallion pattern and why each zone exists
- I can compare Data Lake, MDW, and Lakehouse across 5 dimensions (cost, governance, ML, streaming, performance)
- I can explain the 4 principles of Data Mesh and why it’s an organisational, not just technical, change
- I know the difference between Delta Lake, Iceberg, and Hudi — and can suggest when to use each
- I can design a basic real-time architecture using Kafka, a stream processor, and a lakehouse sink
- I understand what a vector embedding is and how RAG (Retrieval-Augmented Generation) works at a high level
- I can walk someone through the Data’s Grand Tour presentation and answer questions on the architectures covered