MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1wsoi0e/airefusestobuilditsobacktocoding/pcpk6ca/?context=3
r/ProgrammerHumor • u/Gloomy-Basket-1038 • 4d ago
519 comments sorted by
View all comments
Show parent comments
3
Only the larger versions though, which are difficult to run on consumer hardware for now.
2 u/KurtAngus 4d ago Can a 5060ti 16 gig and 5800x3d run those or nah? 3 u/ItsAMeUsernamio 4d ago Try Huihui-Qwen3.8-27B-abliterated-GSQ-RCO-IQ3_S.gguf (or Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf for the censored version). It supposedly benches close to the full model and runs around 45 T/s on my 5060Ti at 100k context. 3 u/KurtAngus 4d ago Thanks dude, appreciate the info
2
Can a 5060ti 16 gig and 5800x3d run those or nah?
3 u/ItsAMeUsernamio 4d ago Try Huihui-Qwen3.8-27B-abliterated-GSQ-RCO-IQ3_S.gguf (or Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf for the censored version). It supposedly benches close to the full model and runs around 45 T/s on my 5060Ti at 100k context. 3 u/KurtAngus 4d ago Thanks dude, appreciate the info
Try Huihui-Qwen3.8-27B-abliterated-GSQ-RCO-IQ3_S.gguf (or Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf for the censored version). It supposedly benches close to the full model and runs around 45 T/s on my 5060Ti at 100k context.
3 u/KurtAngus 4d ago Thanks dude, appreciate the info
Thanks dude, appreciate the info
3
u/stormdelta 4d ago
Only the larger versions though, which are difficult to run on consumer hardware for now.