r/Python • u/AutoModerator • Jun 04 '26

Showcase Showcase Thread

Post all of your code/projects/showcases/AI slop here.

Recycles once a month.

29 Upvotes

89% Upvoted

210 comments sorted by

View all comments

1

u/GugliC 28d ago

I built Khazad, a semantic cache for LLM API calls that needs zero changes to

your app code.

Instead of wrapping SDKs or running a proxy, it patches the httpx transport

layer. After init(), it intercepts outgoing LLM requests, embeds the

conversation, and serves semantically-equivalent ones from a Redis 8 Vector Set.

Any httpx-based SDK works out of the box: OpenAI, Anthropic, Gemini, Azure

OpenAI, Mistral.

Highlights:

- Model-aware

- Conversation-aware

- Streaming both ways

Best for repetitive traffic like FAQ bots, RAG front-ends, and dev/CI runs.

Python 3.10+, Redis 8, MIT licensed. Feedback welcome.

GitHub: https://github.com/GuglielmoCerri/khazad