How Apache Iceberg brings ACID transactions, schema evolution, hidden partitioning, and time travel to object storage — with Spark, Trino, DuckDB, and Flink.
Flink
-
Apache Iceberg: Table Format for the Data Lakehouse -
Real-Time Streaming with Apache Flink: Stateful Stream Processing at Scale A deep dive into Apache Flink — stateful stream processing, windowing, exactly-once semantics, checkpointing, and deploying production Flink jobs on Kubernetes.
-
Data Pipeline Patterns: ETL vs ELT, Streaming, Batch Processing, and Orchestration A practical guide to data pipeline architecture — ETL vs ELT trade-offs, streaming with Kafka and Flink, batch transformation with dbt, and orchestration with Airflow and Dagster.