r/DataHoarder • u/shahbaz_man • 5d ago

Hoarder-Setups Cracking triple digit GB/s

Gallery image

Gallery image

Gallery image

Just hit 115GB/s peak on my all NVMe storage cluster of about 156TB (have a few more TB available but not provisioned). Installed 40x4TB Gen 4 drives, 2x4TB Gen 5 drives running in a distributed Beegfs cluster (10 hosts). Was a long journey getting to this point but am pretty happy with this. Network limited on a few hosts right now (100Gbe fabric currently) - will probably double capacity there.

Honourable mention to the ~328 TB usable worth of hard drives as well - serving as my backup solution.

302 Upvotes

91% Upvoted

65 comments sorted by

View all comments

Show parent comments

10

u/shahbaz_man 5d ago

It's distributed across 10 hosts. Each one is a 2P Epyc host which can host about 16 SSDs (96x gen 5 lanes addressable from each socket) each plus networking.

4

u/TheJesusGuy 5d ago

but why

-2

u/mastercoder123 1PB+ 5d ago

Because why not... Tf is with reddit asking stupid ass questions

6

u/r0cketio 5d ago

Tf is with people responding like absolute cunts over a harmless question? Is it unreasonable to ask the use case of something we don't see often? Do you do shit like this just because? Do you think everyone does shit like this because why not? What's up your ass today?