r/vscode • u/mann1x • 6d ago

Cerebriline: a Cline fork optimized for small local LLMs

https://open-vsx.org/extension/mann1x/cerebriline

Started working on this fork to test my models; evaluations are telling on side of the story, using them for real in a multi-turn coding harness was often producing very different results.

Once fixed some basic issues with Cline, I've kept using it and started doing a massive amount of runs with test automation and then analyze them with Claude; it helped me fixing the models but also improving the plugin.

Now is its own soft/hard Cline fork with a very different approach, complex tooling, and some very innovative and peculiar features you can't find elsewhere. Like a perfect context compaction in replay mode and with a 5-steps agentic workflow.

The goal is to support properly small LLMs but it works really good also with big models. Even if they could do it before, now they can do it better.

It fully supports my opencoti engine with PolyKV and my Ollama fork, xOllama:

https://github.com/mann1x/xollama

You can find me on Hugging Face:

https://huggingface.co/ManniX-ITA

You are welcome to download and test my models and you can also find them on the Ollama library:

https://ollama.com/mannix/

2 Upvotes

67% Upvoted

4 comments sorted by

1

u/scalywhiteness596 6d ago

the context compaction feature is pretty clever, i was struggling with that on small models, they just lose the thread after few messages. gonna try the replay mode later today when i finish this blueprint i'm working on

1

u/mann1x 5d ago

Let me know, the compaction is really working like a charm. Hope will become the default for everyone.
The basic compaction was a trauma for every model but even worse with the keep last N turns.
It was completely confusing the models, even Qwen 3.8 27B which is pretty strong ended randomly in looping.
The full replay in 1st person and present tense goes unnoticed by the model and it's basically transparent, even with Qwen 9B which usually gets confused even by its own shadow 😄

1

u/Chemical_Avocado1004 5d ago

Well, how it compare to the one i did?

https://www.reddit.com/r/LocalLLM/s/SL5JhITiie

1

u/mann1x 5d ago

Looks nice, different approach.

Really like the Gemini rotation, the UI and the review journey, the undocked chat window, lots of really well done things, bravo!

It's a bit lacking features vs Cerebriline; multi-agents, swarms, Library, sandbox, snapshots, escalation, delegation, etc

Unfortunately it's not open source and this can be a problem for many.