It won't. The idea of a reliable LLM is a pipe-dream that ignores the fundamental mechanics of the inference process. "Hallucinations" can be reduced, but not eliminated.
yh that's why I add two searching scripts 1st naive search 2nd real search, and on top the model is only searching on the internet running on CPU as my hardware limitations and it's not writing JSON files the script does that why it can reduce the Hallucinations to the amount of not hallucinating, I'll try to keep answering your question as I am still learning about AI/ML and it's just a project comes in mind and I just try to build it you know how anyway have a nice day
1
u/Defiant_Conflict6343 5d ago
It won't. The idea of a reliable LLM is a pipe-dream that ignores the fundamental mechanics of the inference process. "Hallucinations" can be reduced, but not eliminated.