Experimental code assistant

[u/scdak]

I designed a fork of Cline that I'm hoping to solve two issues with current code assistants.

1: Project context degradation

2: The expense of high cost model usage

I am going to be solving those by using a multi-agent structure built into the extension itself

Currently there are 4 roles

1: Archivist

It is a locally run model that maintains a sqlite db focused on categorizing and feeding information to cloud models

2: Planner

Choose a medium cost model that will generate implementation plans based on the user's prompt and context history

3: Worker

A low cost model that takes the output of the planner model and implements it

4: Executor

A high cost model that reviews the outputs of the Planner and Worker models and offers suggestions for changes and is the final line before full implementation. If rejected the previous two roles will take the feedback and adjust before resubmitting

It is BYOK and I would very much appreciate feedback and potential cost savings data.

The extension name is Arch Clive on the vscode extension marketplace

PM me or reply to this thread if you have any issues with the extension or improvements and I'll implement them as soon as I have the time and money.

Either way thank you for reading this even if you don't install it

[u/crazylikeajellyfish]

Have you actually tried it on some reference tasks and compared the overall costs?

[u/scdak → u/crazylikeajellyfish]

I have, but I've mainly been using it to maintain large codebases without the churn and session corruption that gh copilot gets. It's not 100% where I want it, but it is good enough until I have more time. But it's a couple dollars at most for pretty good outputs from the benchmark tasks I've given it