8.3 Deep dives¶
Short, dense reference pages, one per topic. Use them to review a topic after you have read the full page in GCP & BigQuery knowledge, or as a cheat sheet when you design a real pipeline.
| Deep dive | Covers |
|---|---|
| BigQuery | Architecture, pricing, partitioning, clustering, query plans, MERGE, INFORMATION_SCHEMA |
| Data warehouse modelling | Kimball essentials, SCD types, designing a near real-time sales model |
| Streaming and CDC | Pub/Sub, Dataflow, Datastream, when to use which |
| Composer, Airflow and Dataform | DAG design, restructuring many DAGs, Dataform/dbt, anti-patterns |
| Platform, IAM and Terraform | Project layout, IAM roles, service accounts, Terraform modules, CI/CD |
| Migration and modernization | Migration phases, reconciliation, cutover, risks and mitigations |
| Looker and the semantic layer | LookML, PDTs, aggregate awareness, conversational BI |
| Engineering practices | Python and SQL quality, testing, observability, metrics, AI assistants |