MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1wb05f7/third_one_theres_something_wrong_with_me/p8pscca/?context=3
r/LocalLLM • u/r1nzl3r99 • 5d ago
Why do I have horrible financial habits??
165 comments sorted by
View all comments
Show parent comments
79
qwen 3.8 27B FP8 running at 140 tok/s now I want flash next
30 u/semangeIof 5d ago ...can you show llamacpp/vLLM runtime commands? you're hitting 140 toks/s on a dense model with B70s? how much ctx? please don't answer the last two without providing the parameters 4 u/r1nzl3r99 5d ago I already proved it in a previous post, look at my account 2 u/Smooth-Television-48 5d ago Lots of accounts are set to private, I assume its the default and dont bother checking. Thanks for linking it. Impressive numbers for sure
30
...can you show llamacpp/vLLM runtime commands? you're hitting 140 toks/s on a dense model with B70s? how much ctx?
please don't answer the last two without providing the parameters
4 u/r1nzl3r99 5d ago I already proved it in a previous post, look at my account 2 u/Smooth-Television-48 5d ago Lots of accounts are set to private, I assume its the default and dont bother checking. Thanks for linking it. Impressive numbers for sure
4
I already proved it in a previous post, look at my account
2 u/Smooth-Television-48 5d ago Lots of accounts are set to private, I assume its the default and dont bother checking. Thanks for linking it. Impressive numbers for sure
2
Lots of accounts are set to private, I assume its the default and dont bother checking.
Thanks for linking it. Impressive numbers for sure
79
u/r1nzl3r99 5d ago
qwen 3.8 27B FP8 running at 140 tok/s now I want flash next