- Cadence
- Weekly
- Latest
- 2026-11-02
- By
- Daniel Beach
- Based on
- 12 recent issues
- Covers: Hands-on data engineering tools, pipelines, DuckDB, Polars, Databricks, Apache Airflow, and AI integrations.
- For: Data engineers, data architects, and technical data platform leaders.
- Best for: Data engineers looking for candid technical deep dives and production tool comparisons.
- Skip if: Non-technical business executives or non-engineering data consumers.
Start with
- Polars 2.0 vs DuckDB 2.0: Compares new features and performance changes between two major data processing tools.
- DuckDB vs Polars vs Spark on Databricks Serverless with Joins and Window Functions.: Evaluates performance across DuckDB, Polars, and Spark using complex queries on Databricks.
- AI Is a Mirror: MLOps, LLMOps & the Future of AI Engineering | Maria Vechtomova: Explores what it takes to build and manage production AI systems and MLOps workflows.
Sponsors seen
- Delta Air LinesSponsor
Thanks to Delta for sponsoring this newsletter! I use Delta Lake daily, and I believe it represents the future of Data Engineering.
Databricks LLM (APIs)/Modeling Serving. Thoughts from the Frontline. · 2026-09-20 - Delta Air LinesSponsor
Thanks to Delta for sponsoring this newsletter! I use Delta Lake daily, and I believe it represents the future of Data Engineering.
Back to the Basics. Threads. · 2026-09-14 - Delta Air LinesSponsor
Thanks to Delta for sponsoring this newsletter! I use Delta Lake daily, and I believe it represents the future of Data Engineering.
DuckDB vs Polars vs Spark on Databricks Serverless with Joins and Window Functions. · 2026-10-05 - RudderstackPartner
Today, we are starting a new series in partnership with Rudderstack . Over the next several months, we'll explore modern CDPs
The Modern CDP Manifesto · 2026-10-14 - GizmoDataPartner
this has led me to be able to partner with GizmoData , which I am excited to introduce to you
DuckDB + ArrowFlight = GizmoData · 2026-10-21 - LakeSentrySponsor
The best way to support this Substack is to click the links below and checkout todays sponsor, LakeSentry!
Polars 2.0 vs DuckDB 2.0 · 2026-11-02