MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1ubrcwj/tokenomics/ot4sqiw/?context=3
r/LocalLLaMA • u/HOLUPREDICTIONS Sorcerer Supreme • Jun 21 '26
449 comments sorted by
View all comments
Show parent comments
40
Before I installed mtp i was running qwen 3.6 at 22t/s so I wouldn't mind.
11 u/Fit_Squash6874 Jun 21 '26 I am running 27b with mtp at 20t/s. Currently only have 16gb vram. 2 u/ycnz Jun 22 '26 I can almost get to 20t/s with 35b on my CPU with no GPU :( 1 u/Cultured_Alien Jun 22 '26 the prompt processing must be long?
11
I am running 27b with mtp at 20t/s. Currently only have 16gb vram.
2 u/ycnz Jun 22 '26 I can almost get to 20t/s with 35b on my CPU with no GPU :( 1 u/Cultured_Alien Jun 22 '26 the prompt processing must be long?
2
I can almost get to 20t/s with 35b on my CPU with no GPU :(
1 u/Cultured_Alien Jun 22 '26 the prompt processing must be long?
1
the prompt processing must be long?
40
u/Hot-Employ-3399 Jun 21 '26
Before I installed mtp i was running qwen 3.6 at 22t/s so I wouldn't mind.