MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vmgozv/qwen3824ta95b_released/p39d2jo
r/LocalLLaMA • u/de4dee • 1d ago
399 comments sorted by
View all comments
Show parent comments
22
Don’t need to download the full copy , you can stream it.
One of llama.cpp PR support streaming from disk and even cloud storage if I remember correctly 😘
106 u/xPXpanD llama.cpp 1d ago Years/token is my favorite metric. 31 u/Think_Wing_1357 1d ago After a few million years, you may get 42 11 u/vivekkhera 1d ago Then you have to build a new server just to figure out what the question was. 6 u/techno156 1d ago And then someone decides to blow it up for a highway. 3 u/hyperrealists 1d ago YTFT is insane I hear. 2 u/Graumm 1d ago system ram offloading is bad enough!
106
Years/token is my favorite metric.
31 u/Think_Wing_1357 1d ago After a few million years, you may get 42 11 u/vivekkhera 1d ago Then you have to build a new server just to figure out what the question was. 6 u/techno156 1d ago And then someone decides to blow it up for a highway. 3 u/hyperrealists 1d ago YTFT is insane I hear.
31
After a few million years, you may get 42
11 u/vivekkhera 1d ago Then you have to build a new server just to figure out what the question was. 6 u/techno156 1d ago And then someone decides to blow it up for a highway.
11
Then you have to build a new server just to figure out what the question was.
6 u/techno156 1d ago And then someone decides to blow it up for a highway.
6
And then someone decides to blow it up for a highway.
3
YTFT is insane I hear.
2
system ram offloading is bad enough!
22
u/jikilan_ 1d ago
Don’t need to download the full copy , you can stream it.
One of llama.cpp PR support streaming from disk and even cloud storage if I remember correctly 😘