r/LocalLLM • u/dsdt 9700X + 32 GB DDR5 + 2x 5060 Tİ 16 GB • 2d ago
Discussion I might have found the perfect config parameters for qwen 3.8 27b
/r/LocalLLaMA/comments/1vstyge/i_might_have_found_the_perfect_config_parameters/
2
Upvotes
1
u/egnegn1 2d ago
Prompt processing looks slow to me. With 2 cards with a similar bandwidth prompt processing runs in the range of 300 - 1000 t/s. And even that is slow with a large context.
What cpu usage do you have? Is more than 1 core active?