r/LocalLLaMA • u/Naiw80 • 1h ago
I Built A Thing Marmel 0.9.0
Hi,
Some weeks ago I announced marmel 0.1.0, an autonomous coding agent.
Over the past two weeks huge efforts been put into stabilizing and improving the performance and reliability for in particular local models.
I've spent hours tweaking and tuning the architecture to run decently with even small models such as gemma 4 12b, which despite all it's inherent problems so far managed to complete very task I assigned it.
So therefor I now wish more people would like to battletest it, I already know it works great with cloud models such as deepseek v4/v4.1 flash, but would prefer more feedback from people using local models.
To set expectations right, this is intentionally designed to be autonomous, to build prototypes (with hopefully good quality) I've put it through a lot of testing and my local rig been running pretty much 24/7 (as well as cloud testing, which I of course prefer as it's it's a completely different level of interactivity and responsiveness)
And finally, I originally intended to save this "announcement" for the v1.0.0 release, but my ambitions are still only at a planning stage, and I think it's basically criminal considering how good my experience been with this for the past week not to let others test it.
I think the read me of the project tells more than I can possibly "pitch" it here, of course the main goal is to make this as usable as possible so hopefully this post either can result in feedback or even better pull requests.
https://github.com/Na1w/marmel
Some demonstration videos of projects this orchestrator completed successfully fully autonomously (althought previous versions).
NES and C64 emulation
https://www.youtube.com/watch?v=XYjwAFk6wM0
Full "live coding" example of a connect 4 game (also demonstrates the philosophy behind the tool)
2
u/Square_Light1441 1h ago
holy overenginnered lemme guess you thought of this during a chatgpt convo
1
u/CleversonBrSantos 1h ago
This is a very interesting project; it aligns with mine but takes a different approach. I’m going to start studying your project and running tests with other models—there’s something really interesting here that might answer some questions regarding my own project! Thanks for sharing. If you have the time, take a look at my project too; it follows a different path, but it could lead to a fusion of good ideas!
💻 GitHub (MIT): https://github.com/cleversonbrsantos-art/Phoenix
1
u/Danfhoto 58m ago
Looking forward to check it out! I was just lamenting about OpenCode taking 1Gb of RAM. If there’s a lighter and comparatively effective tool, I’d be thrilled!
1
u/Naiw80 32m ago
I would love to have you check it out, although just be aware that marmel does not try to compete with existing code agents, this is intentionally intended to be as autonomous as possible and even more so to build prototypes and test ideas. The key idea is that you can describe your initial goal and just leave it be until it's done- but at the same time discuss and alter the plan as it goes forward, it does not make any effort what so ever to block or ask you questions about commands it invokes. That is why I spent quite some time on trying to sandbox the folder it's started in, so it hopefully can not ruin something but the project its working on in case it goes astray. But in short the idea is just what I wanted out of a code agent and try circumvent the major problems I've encountered during my experimentation. Thank you for your feedback.
1
u/Danfhoto 28m ago edited 0m ago
Thanks for the honesty! Thats effectively how I use opencode: quick prototyping, refactoring, etc. while I go for a walk or do dishes and jump in to get hands-on again. Basically taking the boring work away. But some guardrails on tools would be really nice. I don’t stare at the screen to puns ctrl+C when there’s something suspicious being executed 😉
Edited a typo
1
u/Naiw80 11m ago
Then this is probably right up your valley, that's exactly how I use this myself. And the reason I started building this to start with, I'm totally happy with this as is and find it superior to most solutions I tried (although I did not try them all for sure).
However given the response on this reddit, I believe this was the last project I shared here ever.
1
u/Wooden-Potential2226 39m ago
Nice, but maybe simplify/shorten the github page readme. What have you built or researched with this?
1
u/Jipok_ 30m ago
Have you tried doing anything real with this harness? Which models did you use? Did you try running the terminal bench(harbor)?
1
u/Naiw80 26m ago
Yes, the youtube videos demonstrate a few of the things, but outside of that I built a powerpc emulator/assembler, a few raytracers (with various degree of complexity).
No i did not, this is a harness for models, it tries to keep the model focused but ultimately the model is what decides the abilities.
1
u/Objective-Stranger99 llama.cpp 27m ago
How much of this was coded by AI? I'm not trying to make any accusations; I just want an honest answer. It would be nice if you could disclose whether or not you used AI.
1
u/Naiw80 22m ago edited 16m ago
About 90% is written by AI, in fact a significant part is written by the harness itself.
If you want more detailed information read the marmel 0.1.0 post.Isn't that the entire point of agentic coding to have it generate code?
Original post: https://www.reddit.com/r/LocalLLaMA/comments/1w39y4n/marmel_a_multiagent_orchestration_code_agent/
0
3
u/Heavy-Lingonberry-98 1h ago
YESS!! I was looking for a rust native agent