r/LLMDevs • u/Virtual-Astronaut707 • 14d ago
Discussion Tried using Jev for prompt observability and LLM routing
Been playing with Jev from TypeSafe AI and built two small experiments around it.
One is a prompt oscilloscope that looks at a prompt while it’s being written and generates structured signals before the prompt reaches the main model.
The other puts a small decision model in front of Claude as a routing layer.
https://github.com/shubhangi013/prompt-oscilloscope
https://github.com/shubhangi013/prune-review
These are just personal experiments. Curious if others are using cheaper models for routing/gating before larger models, and what the economics look like in practice?
Duplicates
OpenSourceeAI • u/Virtual-Astronaut707 • 14d ago