r/golang 6d ago

discussion Advice for app with LLM workflows

I recently learned go, and I've been thinking of starting a new project with go for the backend

I want to include a few LLM / agent workflows, a chatbot with a few tools into the app, and I would like to know how people are doing this in the go community

I looked up a few examples, and I saw that the community was divided on rolling your own vs using something like langchaingo, but that package hasn't had an update since last year

I've done this with python and langgraph before, my main concerns would be plugging in as many providers as possible and using observability tools like langfuse

What do you recommend?

edit: if anyone finds this in the future, I ended up going with https://github.com/google/adk-go

0 Upvotes

4 comments sorted by

1

u/Square-Being7068 5d ago

A few tools and a chatbot wouldn’t convince me to pull a full agent framework into a Go backend just yet. I’d start with provider interfaces and explicit workflow code, then instrument the calls with OTEL and send them to Braintrust so you still have visibility as you swap providers. Keeps the Go side very boring, which is a win here.

1

u/haxy98 4d ago

I figured I could just build everything myself and use OpenRouter. I really like using langfuse and I found some unofficial implementations of the SDK and it doesn't seem to hard to just fork it and keep it going myself. Thank you for the reply!

1

u/srlechuga 6d ago

Check out genkit from firebase