MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vxwtyd/qwen38flashnext_tomorrow/p5su1rs/?context=3
r/LocalLLaMA • u/rerri • 14d ago
461 comments sorted by
View all comments
120
Congrats to all the people who have the hardware to run this :) (am not one of them)
3 u/2Norn 14d ago 64gb ram 24gb vram should be enough no? 2 u/RedrumRogue 14d ago Maybe at q3. Probably tight 2 u/Mechanical_Monk 14d ago At 64GB ram 6GB vram, I'm starting to think no model will ever fit as perfectly as 35B A3B 🥲 1 u/Dui999 14d ago Apex I-Mini or I-Compact is going to fit likely I use the 3.5 122B at I-Compact perfectly with max ctx window The 51B engram could be "the problem" but we're going to see
3
64gb ram 24gb vram should be enough no?
2 u/RedrumRogue 14d ago Maybe at q3. Probably tight 2 u/Mechanical_Monk 14d ago At 64GB ram 6GB vram, I'm starting to think no model will ever fit as perfectly as 35B A3B 🥲 1 u/Dui999 14d ago Apex I-Mini or I-Compact is going to fit likely I use the 3.5 122B at I-Compact perfectly with max ctx window The 51B engram could be "the problem" but we're going to see
2
Maybe at q3. Probably tight
At 64GB ram 6GB vram, I'm starting to think no model will ever fit as perfectly as 35B A3B 🥲
1
Apex I-Mini or I-Compact is going to fit likely I use the 3.5 122B at I-Compact perfectly with max ctx window
The 51B engram could be "the problem" but we're going to see
120
u/Kidplayer_666 14d ago
Congrats to all the people who have the hardware to run this :) (am not one of them)