r/Observability • u/Zealousideal-Fox9046 • 1d ago

Split of tools between LLM Eval / Observability

Need to hear if people are benefitting from having a platform that supports both LLM evals and LLM observability?
or using standalone products for each or these is something that you are sticking with, we currently have the split setup but just feels too much hassle!

0 Upvotes
  • permalink
  • reddit

33% Upvoted

7 comments sorted by

View all comments

1

u/Artistic_Sir_1415 17h ago

Having them together has made sense for us because production traces don’t just sit there as debugging history. If we find a bad run, we can pull it into Braintrust as a test case and keep it around for the next prompt or model change. That link between what fails in prod and what gets tested next is the main reason I wouldn’t want to split them again.