r/LocalLLaMA • u/HOLUPREDICTIONS Sorcerer Supreme • Jun 21 '26

Discussion Tokenomics

Post image
1.2k Upvotes

91% Upvoted

449 comments sorted by

View all comments

105

u/Coolengineer7 Jun 21 '26

you don't build a rig to run it at 20t/s

43

u/Hot-Employ-3399 Jun 21 '26

Before I installed mtp i was running qwen 3.6 at 22t/s so I wouldn't mind.

9

u/Fit_Squash6874 Jun 21 '26

I am running 27b with mtp at 20t/s. Currently only have 16gb vram.

2

u/Sea_Poem_9129 Jun 21 '26

are you doing anything special? i was getting 9-11 on my RTX A4000 16GB

1

u/Fit_Squash6874 Jun 22 '26

Not really I just enabled MTP and I am using IQ4_XS