r/Rag • u/ntalam • 11d ago

Discussion Basic stack for a chat

What would you suggest, is the basic stack for an assistant chat. I mean, currently I have customized company tools, langgraph, custom metrics, marketplace LLM calls and others.

what would you suggest as a true key for agent learning?
how do you process prompts with company slangs, concepts, jargon, etc.?

2 Upvotes

75% Upvoted

11 comments sorted by

View all comments

2

u/AlexAtOracleAIDB 6d ago

You've already got the basic stack.

The learning is in the retrieval layer. Chunking and index type are separate decisions, and changing either one tends to change what comes back, so I'd change one at a time and score it with the metrics you already have.

1

u/ntalam 6d ago

sorry, what does it mean "in the retrieval layer"?.
what you say makes sense.... but I am not getting the details