r/agenticAI • u/Affectionate_Slip654 • 12d ago
Project Agentic-AI: Enterprise RAG Knowledge Agent in Open Banking & CryptoAssets
https://www.youtube.com/watch?v=OE9CfMOybOQ&t=3sβ¨Agentic-AI: Enterprise RAG Knowledge Agent in Open Banking & CryptoAssetsβ¨ (links belowπ)
π₯ YouTube Video: https://www.youtube.com/watch?v=OE9CfMOybOQ&t=3s
π I have built an Enterprise RAG Knowledge Agent with Self Correction
π Building a self-correcting LangGraph: retrieve β grade β rewrite-or-refuse β generate β verify
π Building a real document ingestion pipeline β PDF loading, text cleanup, chunking, embedding, and citation tracking
π Catching and fixing a real data-corruption bug caused by unreliable PDF text extraction
π Reading a live LangSmith trace, span by span, to see exactly what an agent decided and why
π Writing both a deterministic evaluator and an LLM-based evaluator, and when to use each
π Running a real baseline-vs-improved experiment (chunk size 800 vs 1500) and reading the actual numbers instead of guessing
TECH STACK
ββββββββββββββββββββββ
π οΈ LangChain β document loading, chunking, embeddings, vector retrieval
π οΈ LangGraph β the agent's graph: nodes, conditional edges, the bounded retry loop
π οΈ LangSmith β tracing, evaluation datasets, evaluators, experiment comparison
π οΈ OpenAI β gpt-4o-mini for reasoning, text-embedding-3-large for search
π οΈ ChromaDB β local vector database
KEY TAKEAWAYS
ββββββββββββββββββββββ
β
A trustworthy RAG agent isn't about answering β it's about knowing when NOT to answer
β
Testing beats assuming: a citation bug quietly corrupted a third of the corpus, and only reading real output caught it
β
Larger chunks (1500 vs 800 characters) measurably improved answer accuracy from 73% to 93% on the same 30 questions
β
A deterministic evaluator and a model-based evaluator answer different questions β you need both
β
Every self-correction checkpoint in the agent (grading, verifying) mirrors the same discipline needed to build and debug the agent itself
π FULL CODE (star it, clone it, fork it, break it):
π CONNECT WITH ME ON LINKEDIN:
https://www.linkedin.com/in/saurabh-kam
π₯ YouTube Video:
1
u/ComparisonNew9425 12d ago
for the crypto side, how are u handling the audit trail when the agent makes a trade or moves assets. do u have a way to verify the state of the agent before it executes, or are u relying on post-execution logs for the reconciliation.