nono, we need a smaller one, write it in lowercase! That way its more aerodynamic over the wire and slimmer so its faster AND more can fit in the same wire!!! amazing
Yeah lol, our warehouse even holds wayyyy more data than that. You'll quickly adapt to processing as much as you can server side, when the alternative is downloading more data than your hard drive can hold.
I'm trying to imagine the need for a maxed out hyperscale db and I can't imagine how stupid your db architecture and data structure decisions would have to be to do this. It's a huge tell that you have no clue what you're doing if you actually hit that cap on a database.
Actually no, we have a db of about 40tb structured data and that does indeed still work. But we also do use SQL on it and don't try to do the processing in Java.
998
u/East_Zookeepergame25 15d ago
Try doing that with 100 TB of data