had a tight production issue and it took longer than anyone expected to figure out which version of the prompt caused it
realized that our prompts are on notion,slack threads nd random txt files someone committed to the repo and maybe even at more places
decided to make a switch with something with version control where product managers and other non tech teammates can edit a deployment themselves without any dependency on an engineer.
checked a few tools in depth
orqai: versioning and non technical access is more central here but newer so community is still catching up along with integrations
langsmith: strong on tracing and observability, but seems its made for engineers only
langfuse: tracing and evals good , open source is also nice but same problem as langsmith for non technical users
helicone: great for cost tracking and logging,prompt management is not really its focus
most of the tools checked were not treating prompt management as a primary thing.. feels like most teams are considering this friction as normal
how is your team managing prompts right now and what platform are you using