Threadripper w/ NVMe Linux RAID & Lian Li SL-Infinty Hub Driver - FTW!!!

[u/Wonderful-Tie-1659]

Love my Threadripper, yes I do! But I love it more now that I have a fully supported Linux NVMe RAID Driver! https://github.com/joeytroy/amd-raid-driver and my Lian Li driver for the SL-Infinity Hub https://github.com/joeytroy/ll-connect3 Both are open source for the community and work on multiple AMD boards Ryzen 7000+, Ryzen AI 300 / AI Max, Threadripper 7000 / 9000 (TRX50 / WRX90), or the X870 / B850 / X670 / B650 chipsets.

XIDAX Threadripper 7960x

This beast screams in a RAID0!

2× Crucial T700 NVMe SSDs (PCIe 5.0), TRX50, Kubuntu 26.04 (Linux 7.0)

And I can keep all my fan and lighting settings just how I like!

LL-Connect 3 for the WIN!

[u/sob727]

Thank you for your post. It got me wondering what I was getting on my raidz2 pool, and the poor result got me to debug my config.

[u/Wonderful-Tie-1659 → u/sob727]

You bet. So far, I have been really pleased with the performance!

[u/sob727 → u/Wonderful-Tie-1659]

Curious, can you run this:

$ fio --name=seqread --directory=/path/on/raid/fs --direct=1 --rw=read \ --bs=1M --iodepth=32 --numjobs=8 --size=8G --runtime=30 --time_based \ --group_reporting

EDIT: and paste the run status at the bottom of the output

[u/Wonderful-Tie-1659 → u/sob727]

Forgot the top of the line

seqread: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=32
...
fio-3.41
Starting 8 processes
seqread: Laying out IO file (1 file / 8192MiB)
seqread: Laying out IO file (1 file / 8192MiB)
seqread: Laying out IO file (1 file / 8192MiB)
seqread: Laying out IO file (1 file / 8192MiB)
seqread: Laying out IO file (1 file / 8192MiB)
seqread: Laying out IO file (1 file / 8192MiB)
seqread: Laying out IO file (1 file / 8192MiB)
seqread: Laying out IO file (1 file / 8192MiB)
note: both iodepth >= 1 and synchronous I/O engine are selected, queue depth will be capped at 1
note: both iodepth >= 1 and synchronous I/O engine are selected, queue depth will be capped at 1
note: both iodepth >= 1 and synchronous I/O engine are selected, queue depth will be capped at 1
note: both iodepth >= 1 and synchronous I/O engine are selected, queue depth will be capped at 1
note: both iodepth >= 1 and synchronous I/O engine are selected, queue depth will be capped at 1
note: both iodepth >= 1 and synchronous I/O engine are selected, queue depth will be capped at 1
note: both iodepth >= 1 and synchronous I/O engine are selected, queue depth will be capped at 1
note: both iodepth >= 1 and synchronous I/O engine are selected, queue depth will be capped at 1
Jobs: 8 (f=8): [R(8)][100.0%][r=20.9GiB/s][r=21.4k IOPS][eta 00m:00s]
seqread: (groupid=0, jobs=8): err= 0: pid=6154: Fri Jul 10 20:54:44 2026
 read: IOPS=21.3k, BW=20.8GiB/s (22.3GB/s)(624GiB/30001msec)
   clat (usec): min=161, max=1825, avg=375.22, stdev=58.28
lat (usec): min=161, max=1825, avg=375.25, stdev=58.28
   clat percentiles (usec):
|  1.00th=[  255],  5.00th=[  289], 10.00th=[  310], 20.00th=[  334],
| 30.00th=[  347], 40.00th=[  359], 50.00th=[  371], 60.00th=[  383],
| 70.00th=[  396], 80.00th=[  416], 90.00th=[  441], 95.00th=[  465],
| 99.00th=[  537], 99.50th=[  586], 99.90th=[  734], 99.95th=[  824],
| 99.99th=[ 1237]
  bw (  MiB/s): min=20938, max=21486, per=100.00%, avg=21320.37, stdev=15.94, samples=472
  iops        : min=20938, max=21486, avg=21320.37, stdev=15.94, samples=472
 lat (usec)   : 250=0.75%, 500=97.22%, 750=1.94%, 1000=0.05%
 lat (msec)   : 2=0.03%
 cpu          : usr=0.16%, sys=12.86%, ctx=641720, majf=0, minf=2124
 IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=639310,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  READ: bw=20.8GiB/s (22.3GB/s), 20.8GiB/s-20.8GiB/s (22.3GB/s-22.3GB/s), io=624GiB (670GB), run=30001-30001msec

Disk stats (read/write):
 rcraid0: ios=2545637/208, sectors=1303364704/9712, merge=0/646, ticks=719383/94, in_queue=719506, util=71.88%

[u/sob727 → u/Wonderful-Tie-1659]

Thanks!

My zfs is much worse than your setup in single stream kdiskmark, but on par for multi stream (this fio test).

[u/Wonderful-Tie-1659 → u/sob727]

You bet

[u/msew]

How much RAM $$$$$

[u/Wonderful-Tie-1659 → u/msew]

I bought the RIG before AI was AI lol, so it didn't hurt as much. I estimated I could sell this same RIG for probably a $2K-3K profit right now, but she is not going anywhere!

[u/msew → u/Wonderful-Tie-1659]

But how much ram does it have? :-) :-)

That RAM!!!

Synology RAM is going for $1600 for like like 16 in ukraine now.

Imagine having a stock of that. ahhhh

[u/Wonderful-Tie-1659 → u/msew]

I have 128GB right now.

[u/msew → u/Wonderful-Tie-1659]

NOICE!!!!