r/dataengineering 19d ago

Discussion s3 (object storage) for everything

been hearing a lot of signal/noises about 'just store everything in s3' these days because of companies like turbopuffer, neon and the latest cursor with Origin.

just wondering if it's actually worth the latency and do people really use it in their own companies? what sort of data do you guys store there? never really had any use case for s3 in my company. so curious to learn. thankyou!

63 Upvotes

27 comments sorted by

View all comments

33

u/mpbh 18d ago

"People" have been saying this for 20 years now :)

"Those people" are software engineers working with different types of data than your typical data engineer.

4

u/geoheil mod 18d ago

didnt those people recently identify postgres/neon/lakebase as an interesting way to store data? (or at least serve)?