Pipeline to Dashboardnihalsulaiman.com

Course › Week 7

Week 7. Run it in production

Observability, CI/CD, tool choices, the low-cost open stack, capstone.

The last week is about running a platform, not just building one: monitoring, CI/CD, choosing tools with a written rationale, and designing the low-cost open-source stack for a medium-sized company. Then you ship the capstone.

Proof project 7 (capstone): daily-data-platform: one repo that ingests all four sectors, orchestrates with Dagster, models with dbt, loads Postgres (and Azure SQL), serves Metabase and Power BI, has CI, monitoring and a cost model. This is the project you talk about in interviews.

Days

  1. Day 43 Observability and incident response 4h · learn 70m · lab 135m · ship 20m · review 15m
  2. Day 44 CI/CD, environments and safe change 4h · learn 60m · lab 145m · ship 20m · review 15m
  3. Day 45 Choosing tools with a written rationale 4h · learn 80m · lab 125m · ship 20m · review 15m
  4. Day 46 The low-cost open-source stack for medium companies 4h · learn 90m · lab 115m · ship 20m · review 15m
  5. Day 47 Performance, scale and when to change gear 4h · learn 70m · lab 135m · ship 20m · review 15m
  6. Day 48 Capstone build: daily-data-platform 4h · build 210m · review 30m
  7. Day 49 Ship it and tell the story 4h · README 60m · video 45m · write-up 60m · interview prep 75m