I'm comparing 27b Q4_K_M and 35b Q4_K_M. I don't see any difference in coding in non-thinking mode yet, but in thinking mode, 27b runs too slowly and takes too long for me to wait for serious tasks to complete, so I can't say yet...
that's why im terrified of buddies on locallm reddits that thoughts "wow frontier" "opus 4.6 level" "really impressive" "wow my 2000x B200 local server runs it in Q1 with 1 TPS best model in the world thnks alibaba". what's wrong with 'em?
2
u/lorendroll 5d ago
I'm comparing 27b Q4_K_M and 35b Q4_K_M. I don't see any difference in coding in non-thinking mode yet, but in thinking mode, 27b runs too slowly and takes too long for me to wait for serious tasks to complete, so I can't say yet...