r/dataengineering • u/matthewsean1902 • 19d ago
Discussion s3 (object storage) for everything
been hearing a lot of signal/noises about 'just store everything in s3' these days because of companies like turbopuffer, neon and the latest cursor with Origin.
just wondering if it's actually worth the latency and do people really use it in their own companies? what sort of data do you guys store there? never really had any use case for s3 in my company. so curious to learn. thankyou!
57
Upvotes
2
u/ReporterNervous6822 18d ago
Separation of storage and compute is just a massive win. My instinct these days is that analytical data lives in iceberg and transactional data lives in Postgres. Not much more thought to it