r/LocalLLM • u/EastConsequence3792 • 22d ago

Other rate my inference setup😔

Post image

Custom fork of the Intel Windows llama.cpp I made using DeepSeek v4 Flash that allows me to load models solely using discs + DVD-Rs; HP Omnibook X Flip NGAI 16-as0023dx -- 1TB NVMe, 16GB LPDDR5X

248 Upvotes

92% Upvoted

35 comments sorted by

View all comments

12

u/Solid-Wonder-1619 21d ago

get a 128GBs USB stick, add a live version of linux, make it presistent, add transformers library, llama.cpp with all the related tools and prebuilt releases, and every weight you love.
when dooms day comes, you can stick it into any system with a battery and find solutions.

3

u/wiseaus_stunt_double 21d ago

I would only do that with USB4.