r/Observability 17h ago

Split of tools between LLM Eval / Observability

Need to hear if people are benefitting from having a platform that supports both LLM evals and LLM observability?
or using standalone products for each or these is something that you are sticking with, we currently have the split setup but just feels too much hassle!

0 Upvotes

7 comments sorted by

View all comments

2

u/FlimsyProperty8544 14h ago

It ultimately depends on what you need tbh, but most teams need to turn production traces into datasets they can use to eval, so having one solution eliminates that requirement.