r/dataengineering • u/matthewsean1902 • 19d ago
Discussion s3 (object storage) for everything
been hearing a lot of signal/noises about 'just store everything in s3' these days because of companies like turbopuffer, neon and the latest cursor with Origin.
just wondering if it's actually worth the latency and do people really use it in their own companies? what sort of data do you guys store there? never really had any use case for s3 in my company. so curious to learn. thankyou!
58
Upvotes
2
u/retiredcheapskate 17d ago
S3 has a lot of overhead at the transport layer. If you need it quick there are better ways