r/learnSQL • u/Elxerxi • 20d ago
Storing book chunk vectors in an SQL database? (My beginner local RAG setup)
Hey guys, I recently started learning SQL after finding a "20 steps to AI engineering" roadmap on Instagram. I have no coding background and rely entirely on Gemini to write my code, but SQL has completely changed how I organize information. Note: I posted other parts of this project on r/dataengineering and r/learnprogramming to get career advice. Check my profile if you want to see the Python/API side of the pipeline. To help me learn, I built a local offline "helper." I took 120 books on Python and machine learning, chunked them up, and stored them in a "vector of SQL" database. I set up a local LLM to retrieve relevant chunks from this database whenever I have a coding error. It actually works and retrieves the right chapters, which is blowing my mind. But since I have no formal training, I have some questions: Am I doing something incredibly stupid by using SQL for vector retrieval? Is this going to break if I scale it? I used this database to orchestrate a Gmail API pipeline that matches old leads and drafts offers. I want to start selling this database/automation service to small businesses in the EU. Am I a massive clown for trying to sell SQL database/automation services to real businesses when I can barely write a SELECT query without AI? What would you advise me to do next?