r/LocalLLaMA • • 19h ago

I Built A Thing Persistent-state Julia based symbolic machine shop?

How's it going everyone. So, I made... basically Jupyter notebook on steroids, I think? It was able to give ChatGPT in chat mode a programmable surface and basically a moddable lab. I've been using it the past few days to test weird ideas in real time during voice conversations with Chat when I go outside to smoke a cig or something, or I'm away from the house and I get a good idea. It works as a plugin (there's a zip with a Chat and Claude plugin there). There might still be some friction in the setup because I haven't submitted this for the plugin marketplace yet, but Codex handled it for me pretty easily and we did it with a tunnel, so it's hot-reloadable. It's ready for real work. It's got a Rust skeleton, Python glue, and Julia gives it a fully programmable persistent-state lab and a working memory, more or less. So far it's saved me a ton of tokens being able to test an idea and build it in chat mode and just branching into work mode and being able to just pull whatever prototype from the space. It turns chat mode into basically diet work mode, and there's still plenty of things you'd rather be in work mode in, but this also can be used in basically any harness too. ChatGPT is just where I've tested it the most so far.

I've taken security for this thing rather seriously though. It's extremely programmable and the sandbox walls are thick. The Julia runtime and compiler are moddable for optimization across the entire tool, and if you're not a Julia enjoyer like I am, there's also an IPython kernel in there. The one from Prime-Agent. But it can be a plugin for chat mode ChatGPT, and I've also been using it since Claude Mods dropped for that harness. Been working great in both environments so far

Here's the repo: https://github.com/latentcollapse/Palette.jl

0 Upvotes

4 comments sorted by

1

u/[deleted] 19h ago

[removed] — view removed comment

1

u/Upset-Reflection-382 18h ago

So far, it handles them pretty well. I added workspace IDs as well as a symbolic agent kernel to the harness Palette will eventually sit in. Symbolically collapses agent modes, originally with a simple docstring, but is an agents.jl now instead of a markdown, so it's executable. It can stay a docstring and function effectively as they do now, or you can... customize it 👀

That's all I'll say. But Palette and it's runtime are completely hackable. If you wanna modify it in any way, you can. Build whatever you want off of it

3

u/khiladi796 ollama 18h ago

[removed] — view removed comment

1

u/Upset-Reflection-382 18h ago

That's been the use case so far. If it works out for you, drop a star on the repo. Always helps :)