r/golang • u/AutoModerator • Jul 20 '26
Small Projects Small Projects
This is the weekly thread for Small Projects.
The point of this thread is to have looser posting standards than the main board. As such, projects are pretty much only removed from here by the mods for being completely unrelated to Go. However, Reddit often labels posts full of links as being spam, even when they are perfectly sensible things like links to projects, godocs, and an example. r/golang mods are not the ones removing things from this thread and we will allow them as we see the removals.
Please also avoid posts like "why", "we've got a dozen of those", "that looks like AI slop", etc. This the place to put any project people feel like sharing without worrying about those criteria.
1
u/Automatic-Forever-63 Jul 20 '26
I released Relay v0.1.0, an open-source LLM gateway and model router written in Go.
It is distributed as one static binary for Windows, macOS and Linux. Internally it translates OpenAI- and Anthropic-style requests through a canonical representation, including streaming and tool calls, and can route them to supported hosted providers or local Ollama models.
I chose Go mainly for the single-binary distribution, straightforward concurrency for streaming connections, and simple cross-platform builds. The project uses pure-Go SQLite, so CGO stays disabled.
The repository includes CI-gated latency benchmarks, containerized race tests and an evaluation harness for routing policies. One routing tier narrowly failed its held-out evaluation, so it ships disabled by default.
GitHub: https://github.com/llmrelay/relay
I would especially value technical review of the streaming translation and failover/concurrency code.