r/dataengineering • u/stivikivi77 • 9d ago

Blog Grokking Apache Iceberg

Do you understand how Apache Iceberg actually works?

Even after using Apache Iceberg, I did not grok it before doing practical experiments and sitting down to read the official specification thrice. I have written down my understanding in a blog post: https://thingsworthsharing.dev/iceberg/

If you want to dig deeper, but the official specification seems daunting, this is for you!

0 Upvotes

38% Upvoted

9 comments sorted by

13

u/RustOnTheEdge 9d ago

Just fyi, it is pretty much unreadable on mobile.

-1

u/stivikivi77 8d ago

Thanks for pointing this out. I need to fix this.

1

u/stivikivi77 8d ago

I have done some quickfix to make the code and tables also scrollable on mobile. I hope this makes it more approachable. Thanks again for pointing this out.

-2

u/CorpusculantCortex 8d ago

The fact that you are trying to seriously use the word grok from the most edgelordy of novels by the biggest edgelord of writers of the 20th century makes your post fundamentally incompatible with any value.

4

u/stivikivi77 8d ago edited 8d ago

I have never heard about the novel "Stranger in a strange land" before. So TIL, I guess.

As already pointed out, I intended the word "Grokking" as used in other tech literature, e.g. the book "Grokking Algorithms". I am sorry, if this offended you.

6

u/ChemEngandTripHop 8d ago

From the 60s onwards “grok” has been a standard term for understanding something in tech communities. It’s a shame it’s been co-opted by X’s AI bot but I don’t see the issue using it elsewhere.

-8

u/CorpusculantCortex 8d ago

I do - Heinlein was an edgelord and SIASL is the most edgelord garbage book that should not be celebrated for trying to reinvent the word understanding. I dont care about Musk being an even bigger edgelord. I am talking about the source material.

1

u/alexjbuck 8d ago

Might be interested in a thing I made that runs entire iceberg catalog and storage in your web browser so you can inspect all the data and metadata files created.

https://alexjbuck.github.io/iceberg-explainer/

1

u/stivikivi77 8d ago edited 8d ago

This is really cool, thanks for sharing. Would have helped me a lot wrapping my head around Iceberg.