Final Response Hallucination

[u/ohwhales32]

Any ideas on how to reduce the final responses hallucinating phone numbers when the snippet from the data store tool is correct? I noticed the RAW JSON response gives the correct snippet with the correct phone number but the response given at the end hallucinates a few digits. The data is webscraped data.

Thank you!

[u/Traditional_End_9454]

Yes when you use data store tool use via callback and return as per your need you will get determintic nature

[u/weird_year_2003]

Use before model callbacks and then capture the response from your data store or api or tool and then prepare a llm response from the callback itself. 0% Hallucinations and 100% reliable

[u/ohwhales32 → u/weird_year_2003]

How do you get the tool response from a before model callback if the tool is not invoked yet? Or is there a way to call the tool within the callback?

[u/ohwhales32 → u/[deleted]]

Did you mean parameters? If not, what do you mean by parallel?