LINKED LIST [txt mode] ▸ 650GB of Data (Delta Lake on S3). Pol...

home explore | log in

650GB of Data (Delta Lake on S3). Polars vs DuckDB vs Daft vs Spark.

dataengineeringcentral.substack.com · first added by @hnl · 2026-02-27 · 2 upvotes

log in to save, upvote or flag this.

─── In 1 list ──────────────────────────────────────────

* Issue #771 by @hnl [data]

─── Discussions ────────────────────────────────────────

* 650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. Daft vs. Spark

263 pts · 107 comments · node

─── From the discussion ────────────────────────────────

* DuckLake is an integrated data lake and catalog format

ducklake.select · node

* Deletion vectors · Issue #1094 · delta-io/delta-rs

github.com · node

* GitHub - Eventual-Inc/Daft: High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

github.com · node

* GitHub - boringdata/boring-catalog

github.com · node

* Data Inlining

ducklake.select · node

─── Also saved alongside this ──────────────────────────

* Steam Machine

3 upvotes · 2026-02-27

* The 'Toy Story' You Remember

3 upvotes · 2026-02-27

* Marble Fountain

3 upvotes · 2026-02-27

3 upvotes · 2026-02-27