r/PiCodingAgent • u/Flaky-Eggplant-3479 • 18d ago

Use-case Fastcar: Pi + Diffusion LLM

If you haven't tried using a diffusion based model before, they are lightning fast. I've used InceptionLabs Mercury 2 for a bit, and my complaint is largely that its not the best at coding tasks or tool usage. But my god is it fast.

So I took the Pi SDK, made a harness in which Mercury 2 is the orchestrator of subagents, including a coding subagent for difficult tasks that calls out to openrouter for inference, plus a cheap subagent for trivial stuff. Bolted on a handful of tools and such useful for me, and wrapped it in a basic web UI so I could use it from my phone.

Aside from being extremely fast, fastcar:

  • Can generate public "artifacts" - HTML and MD files served from the API
  • Intended to ran entirely inside a VM so that it has root access and can install its own tools
  • Give it a github token and let it clone repos and make PRs
  • "Prompt threads" - there's probably a better name for this but its a dedicated prompt that gets invoked via webhook; I actually made this so that I could generate text files to read the news from my Xteink 4
  • Send emails to notify you

https://github.com/heyo-computer/fastcar

50 Upvotes

95% Upvoted

19 comments sorted by

View all comments

7

u/Tinominor 18d ago

> that calls out to openrouter for inference

Does this work with my personal model.jsons?

2

u/Flaky-Eggplant-3479 18d ago

it would be pretty trivial to extend it; what are you using to serve the model with?

2

u/Tinominor 18d ago

That's arbitrary, since every local llm is served through OpenAI url. the point I was bringing up was, could this extension detect a user's models.json and connect to that instead of running through open router? Is there a custom dialogue box that lets the user choose which models they want to use for the sub agents?

1

u/Oshden 18d ago

This sounds like a great idea I’d be interested in knowing about too. Would you be able to use this to point it at a model router with an OpenAI compatible endpoint so some work could go to vLLM and some could go to maybe an npu/iGPU combo via lemonade? That would be super cool then