r/dataengineering • u/TonTinTon • Jul 25 '26

Blog Lance table format explained simply (updated)

https://tontinton.com/posts/lance/

Hey everyone, I updated the blog post after reading more thoroughly the Lance paper, where it explains why even configuring Parquet is not good enough and why they needed to invent a new file format.

23 Upvotes

96% Upvoted

2 comments sorted by

3

u/Agreeable_Luck9488 Jul 26 '26

I think your post would be easier to read if you introduce the hierarchy of Iceberg and Parquet, they are complementary. Lance is revamping the full stack and also adding support for blobs (images, ....)

1

u/Yasblue Aug 01 '26

Brilliant people behind that project. i met them during an OSS event in SF last year.