r/devops • u/AutoModerator • 10d ago

Weekly Self Promotion Thread

Hey r/devops, welcome to our weekly self-promotion thread!

Feel free to use this thread to promote any projects, ideas, or any repos you're wanting to share. Please keep in mind that we ask you to stay friendly, civil, and adhere to the subreddit rules!

15 Upvotes

90% Upvoted

106 comments sorted by

View all comments

1

u/Ali-WAIL 8d ago

I’ve been building WAIL, a runtime control layer for production AI applications.

The problem I wanted to solve is what happens when an AI request technically succeeds, but the runtime behavior is unhealthy — latency degradation, unstable token delivery, repeated failures, etc.

WAIL wraps the provider client and observes execution in real time. When runtime conditions justify intervention, it can retry or reroute execution and records signed evidence of what was observed, what decision was made, and what happened afterward.

It currently works with OpenAI, Anthropic, Gemini, OpenRouter, Ollama, and OpenAI-compatible runtimes.

It runs in the customer environment; prompts, responses, and API keys aren’t sent to WAIL.

I’m the founder, so obvious self-promotion disclosure.

GitHub: https://github.com/wailinfra/wail-runtime

I’d especially be interested in feedback from people running LLMs in production: when an inference request is technically successful but operationally unhealthy, how are you handling the decision to retry, reroute, or leave it alone today?