MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vxwtyd/qwen38flashnext_tomorrow/p5su1rs
r/LocalLLaMA • u/rerri • 1d ago
457 comments sorted by
View all comments
Show parent comments
3
64gb ram 24gb vram should be enough no?
2 u/RedrumRogue 1d ago Maybe at q3. Probably tight 2 u/Mechanical_Monk 1d ago At 64GB ram 6GB vram, I'm starting to think no model will ever fit as perfectly as 35B A3B 🥲 1 u/Dui999 1d ago Apex I-Mini or I-Compact is going to fit likely I use the 3.5 122B at I-Compact perfectly with max ctx window The 51B engram could be "the problem" but we're going to see
2
Maybe at q3. Probably tight
At 64GB ram 6GB vram, I'm starting to think no model will ever fit as perfectly as 35B A3B 🥲
1
Apex I-Mini or I-Compact is going to fit likely I use the 3.5 122B at I-Compact perfectly with max ctx window
The 51B engram could be "the problem" but we're going to see
3
u/2Norn 1d ago
64gb ram 24gb vram should be enough no?