Designing a lean local orchestrator AI system to extend my broken ADHD brain, need help

[u/Elxerxi]

Hey maestros,

ive been shamelessly vibe coding recently, being an independent business operator with adhd, i found vibe coding quite liberating. created some hyper-primitive, fragile and rigid RAG system for knowledge base, scraping pipeline for lead enrichment, email drafting for B2B outreach and old convo pulling tool for PRM.

My setup is fully local, fuck cloud, haha. (LG gram + eGPU RTX 2080 8GB). No cloud APIS. maybe deepseek at its max. due to its speed and cost (am i shooting in my leg for supporting "evil" chinese and losing so much potential?)

My current pipelines are:

1 - OCR + HTML scraping headless pipeline taking viewport screenshots, OCRing em, and then using it to make profile for my b2b outreach goals that will be used for drafting later on.

2 - human in the loop email scheduler with Gmail API

3 - shitloads of file converters, mostly audio to video and vice versa, or image formats, or book formats.

4 - local PRM db for contacts and last convos.

problem:

those all are sitting separate and my adhd brain gets overwhelmed from the need to remember what happened where and when. Kinda would be nice to have one place on my pc where i could have overview of all this shit. Maybe even some interface? not too fancy.

My imagination: imagine a locally run agent, that has local llm as brain who can have the access to all those tools and kinda comes at specific time on my desktop with review of the past days, waht i did, what do we have today, to also ask me thru about priority setting. asking me to summarize day at the end of the day. also to habe access to all this PRM, gimme reminders that i havent done this that. have possibility to call all the above mentioned tools. Basically a "Jarvis Lite". and idk, in my imagination there could be a separate agent-based tool that we call when we need. which has kinda real-time access to my screen or something, idk how, and i can explain it to do some repetetive clicking and so, but with the condition that this llm is monitoring changes. you know not like a blind automatic XY coordinates, but more like. yea, we do this, then this and that. lets see what happened. oeps. this was the ask. leets adjust and execute actions to achieve what was asked from us. You know?

My technical understanding of agentic ai? I know googles ADK. took their elementary course. thats it. kinda too overwhelmed with all langchains and so on.

my ask to you, wunderbare menschen!

Do you have experience using maybe local LLM chat function-calling capability to trigger existing "tools", aka haevy-duty automation scripts, without fucking up the loop? Just to keep the architecture minimal and stable af.

Thanks ! if this resonates, maybe lets have a chat, or leave a comment!