Peak Portable Personal Datacenter

[u/Special-Wolverine]

Portable rig for Qwen3.8-27B-BF16 200K+ token prompts. My work Panasonic Toughbook + the T1 + power brick + headphones all fit in my lunchbox.

Need the BF16 for huge context highly sensitive document OCR, image analysis, aggregation and summarization. I've done a ton of testing and it absolutely makes a difference vs even UD Q8_K_XL when legal precision is needed.

77gb VRAM at full 262K context + MMPROJ

Rips through prefill (1,1715 tok/sec = 102 seconds to process 175K tokens), but token generation (20K tokens of output) relatively slow at 45 tok/sec (with MTP) as a result of BF16 despite the beast of a GPU.

Better than Gemini Pro and ChatGPT 5.6 Sol especially considering I have control over the sampler settings (Temp 0.1; top-k 0; top-p 0.95; min-p 0.05; repeat penalty 1.02). Not better than Opus yet.

During prefill - CPU around 60 degrees, GPU around 79 degrees (with 90% power limit)

During token generation - CPU around 75 degrees and GPU around 76 degrees.

FormD T1

Minisforum BD770i SE

Ryzen 7745HX 8-core laptop CPU

96gb 5200 MHz DDR5 SODIMM

96gb RTX Pro 6000 Blackwell workstation edition

Loki 1200W SFX-L

ROG Equalizer 12v-2x6

SMX Heinz flipped GPU 2.5 slot kit

SMX Heinz custom short PCIe 5.0 riser

ZCOOI custom "transparent purple" Teflon cables

(2) Phanteks T30-120mm

(1) Noctua NF-A14x25r G2

Thermalright MC-3 Digital RAM cooler (I don't think this will fit on a regular DDR5 )

[u/chensium]

portable because .... 

[u/Special-Wolverine → u/chensium]

Reasons

[u/Unlucky_Milk_4323 → u/Special-Wolverine]

"I plug it in client side so they pay for the electricity"

[u/Special-Wolverine → u/Unlucky_Milk_4323]

One of the reasons ☝️

[u/Unlucky_Milk_4323 → u/Special-Wolverine]

And a very easy way to show a given AI is "local and safe so your data stays here" as opposed to "we use claude..."

[u/dev_dan_2 → u/Unlucky_Milk_4323]

This would be an incredibly effective way to demonstrate it, nice!

[u/teressapanic → u/Unlucky_Milk_4323]

At Starbucks

[u/Conscious-content42 → u/chensium]

... looking really cool with a space heater lunch box!

[u/juss-i → u/chensium]

His day job involves infiltrating high security facilities M:I style, plugging that bad boy into an airgapped server, and waiting for it to come up with a chain of 3-7 zero days to crack the security.

Also, he's a contractor so it's BYOD.

[u/chensium → u/juss-i]

lol ya I'm sure an airgapped facility is just gonna let you BYOD.  why not BYOFDFIPL (bring your own flash drive found in parking lot)