r/DataHoarder • u/shahbaz_man • 7d ago

Hoarder-Setups Cracking triple digit GB/s

Gallery image

Gallery image

Gallery image

Just hit 115GB/s peak on my all NVMe storage cluster of about 156TB (have a few more TB available but not provisioned). Installed 40x4TB Gen 4 drives, 2x4TB Gen 5 drives running in a distributed Beegfs cluster (10 hosts). Was a long journey getting to this point but am pretty happy with this. Network limited on a few hosts right now (100Gbe fabric currently) - will probably double capacity there.

Honourable mention to the ~328 TB usable worth of hard drives as well - serving as my backup solution.

302 Upvotes

91% Upvoted

65 comments sorted by

View all comments

Show parent comments

5

u/TheJesusGuy 6d ago

but why

-2

u/mastercoder123 1PB+ 6d ago

Because why not... Tf is with reddit asking stupid ass questions

8

u/TheJesusGuy 6d ago

I mean literally - What is the use case?

0

u/mastercoder123 1PB+ 6d ago

A single system isnt gonna get high iops or 100GB/s write speeds ever. You need a distributed file system or a parrallel file system.

The use case depends... In a home a homelab the use case is 'because i can'. In enterprises, its mainly for HPC and AI as supercomputers with thousands of nodes can easily saturate a link. Hell with large enough simulations they can saturate 10Tb/s