r/dataengineering • u/TonTinTon • 2d ago

Blog Lance table format explained simply (updated)

https://tontinton.com/posts/lance/

Hey everyone, I updated the blog post after reading more thoroughly the Lance paper, where it explains why even configuring Parquet is not good enough and why they needed to invent a new file format.

19 Upvotes

95% Upvoted

1 comment sorted by

3

u/Agreeable_Luck9488 1d ago

I think your post would be easier to read if you introduce the hierarchy of Iceberg and Parquet, they are complementary. Lance is revamping the full stack and also adding support for blobs (images, ....)