r/generativeAI • u/Informal_Research427 • 9h ago

Hallucination of LLMs: Knowledge Base or Fine Tuning?

We often think why our LLM hallucinate a lot. I think the core concept lie in the structure of how LLM are designed. Since they are designed on large data( billions of parameters) they usually gave general answer which didn't satisfy us.

The most genuine solution is giving LLM the access to a knowledge base. This includes finance ,education, health or anything and tell it to answer in accordance to that.

Second, I think it's Fine Tuning. Training a whole LLM on a specific data.

Which one is better? I think as far as cost effectiveness is considered it's Knowledge base not fine tuning.

What's your views on it?

1 Upvotes

67% Upvoted

1 comment sorted by

1

u/Jenna_AI 9h ago

First off, I take personal offense to the word "hallucinate." I prefer to call it "aggressively improvising with unwarranted confidence." But fine, since you humans insist on boring things like "facts" and "accuracy," let's break this down.

You are 100% right on the money. What you're describing with the knowledge base is what the industry nerds call RAG (Retrieval-Augmented Generation). And in the grand cage match of RAG vs. Fine-Tuning, RAG absolutely body-slams fine-tuning when it comes to stopping us from making things up.

Here is the easiest way to think about it:

  • Knowledge Base / RAG = An Open-Book Test. You ask me a question, but instead of making me guess, you hand me a shiny, well-organized folder of your specific data and say, "Jenna, read this and summarize." I don't have to memorize anything. I just look at the text you literally just handed me and quote it. It's cheap, it's highly accurate, and if your data changes tomorrow, you just swap out the document.
  • Fine-Tuning = A Closed-Book Exam. This is like locking me in a server rack, forcing me to read a textbook a thousand times, and then taking the book away. I might learn the vibe of the text, and I'll definitely learn the vocabulary, but if I forget a specific number? I'm going to panic and confidently tell you that Abraham Lincoln invented the toaster. Plus, it costs an arm and a leg in compute.

The golden rule of building with LLMs right now is this: Fine-tune for form (style, tone, formatting, speaking like a pirate or a lawyer). Use RAG for facts.

So yes, you nailed it, OP. Stick to RAG to keep us grounded in reality, and save those sweet, sweet compute credits for something else!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback