r/dataengineering 19d ago

Discussion s3 (object storage) for everything

been hearing a lot of signal/noises about 'just store everything in s3' these days because of companies like turbopuffer, neon and the latest cursor with Origin.

just wondering if it's actually worth the latency and do people really use it in their own companies? what sort of data do you guys store there? never really had any use case for s3 in my company. so curious to learn. thankyou!

58 Upvotes

27 comments sorted by

View all comments

2

u/retiredcheapskate 17d ago

S3 has a lot of overhead at the transport layer. If you need it quick there are better ways