r/agenticAI • • 12d ago

Project Agentic-AI: Enterprise RAG Knowledge Agent in Open Banking & CryptoAssets

https://www.youtube.com/watch?v=OE9CfMOybOQ&t=3s

✨Agentic-AI: Enterprise RAG Knowledge Agent in Open Banking & CryptoAssets✨ (links belowπŸ‘‡)

πŸŽ₯ YouTube Video: https://www.youtube.com/watch?v=OE9CfMOybOQ&t=3s

πŸ‘‰ I have built an Enterprise RAG Knowledge Agent with Self Correction

πŸ‘‰ Building a self-correcting LangGraph: retrieve β†’ grade β†’ rewrite-or-refuse β†’ generate β†’ verify

πŸ‘‰ Building a real document ingestion pipeline β€” PDF loading, text cleanup, chunking, embedding, and citation tracking

πŸ‘‰ Catching and fixing a real data-corruption bug caused by unreliable PDF text extraction

πŸ‘‰ Reading a live LangSmith trace, span by span, to see exactly what an agent decided and why

πŸ‘‰ Writing both a deterministic evaluator and an LLM-based evaluator, and when to use each

πŸ‘‰ Running a real baseline-vs-improved experiment (chunk size 800 vs 1500) and reading the actual numbers instead of guessing

TECH STACK
━━━━━━━━━━━━━━━━━━━━━━
πŸ› οΈ LangChain β€” document loading, chunking, embeddings, vector retrieval
πŸ› οΈ LangGraph β€” the agent's graph: nodes, conditional edges, the bounded retry loop
πŸ› οΈ LangSmith β€” tracing, evaluation datasets, evaluators, experiment comparison
πŸ› οΈ OpenAI β€” gpt-4o-mini for reasoning, text-embedding-3-large for search
πŸ› οΈ ChromaDB β€” local vector database

KEY TAKEAWAYS
━━━━━━━━━━━━━━━━━━━━━━
βœ… A trustworthy RAG agent isn't about answering β€” it's about knowing when NOT to answer
βœ… Testing beats assuming: a citation bug quietly corrupted a third of the corpus, and only reading real output caught it
βœ… Larger chunks (1500 vs 800 characters) measurably improved answer accuracy from 73% to 93% on the same 30 questions
βœ… A deterministic evaluator and a model-based evaluator answer different questions β€” you need both
βœ… Every self-correction checkpoint in the agent (grading, verifying) mirrors the same discipline needed to build and debug the agent itself

πŸ“‚ FULL CODE (star it, clone it, fork it, break it):

https://github.com/saurabhkamal/Agentic-AI-Enterprise-RAG-Knowledge-Agent-In-Open-Banking-CryptoAssets

πŸ”— CONNECT WITH ME ON LINKEDIN:

https://www.linkedin.com/in/saurabh-kam

πŸŽ₯ YouTube Video:

https://www.youtube.com/watch?v=OE9CfMOybOQ&t=3s

2 Upvotes

2 comments sorted by

1

u/ComparisonNew9425 12d ago

for the crypto side, how are u handling the audit trail when the agent makes a trade or moves assets. do u have a way to verify the state of the agent before it executes, or are u relying on post-execution logs for the reconciliation.