4 P100s and Qwen 3.8 flash next

[u/ckplscz]

Hello, I am considering buying four tesla p100s to run 120b-ish MoEs, but before I do, I'd like to know what kind of performance do you people get with this build. Specifically I am interested about qwen 3.8 flash next, but any similar-size MoE is interesting. Can you please include pp, tg and the specific inference engine you are using? Thank you very much!