A practical guide to data pipeline architecture — ETL vs ELT trade-offs, streaming with Kafka and Flink, batch transformation with dbt, and orchestration with Airflow and Dagster.
Storage & Data Engineering
-
Data Pipeline Patterns: ETL vs ELT, Streaming, Batch Processing, and Orchestration -
Object Storage Internals: How S3-Compatible Storage Works and Self-Hosting with MinIO A deep dive into how S3-compatible object storage works under the hood — consistency models, multipart uploads, lifecycle policies, erasure coding, and running production-grade storage with MinIO.