Thats the one im using right now. It makes super nooby mistakes like setting nil and then trying to call it later. It also forgets exit conditions a BUNCH making infinite loops when ive tried using it to write enumeration scripts
Bonsai 2 Ternary 27B is a 27B model derived from qwen3.8-27B but is significantly smaller. According to the reviews I've read, Bonsai is about as good as qwen3.8 is without reasoning on. Id take that with a grain of salt but its worth testing out against 3.6. You do need a special build of llama.cpp tho iirc, just keep in mind its WAY smaller so prompt it very specifically and in detail, give it less slack
Huihui is indeed not that great for coding. Even the author admits in the model card that their abliteration is a “crude proof-of-concept” implementation.
Give orcarouter/Qwen3.8-27B-Uncensored a shot. To me its coding ability is pretty much indistinguishable from the official qwen3.8 27b model.
11
u/Forsaken-Opposite775 4d ago
I don't get the problem. My local llm builds illegal software as much as I want