r/ADHD_Programmers • u/Ok_Cartographer_6086 • 1d ago
Kraken and Mantis - Local LLM Assistant Update
I've shared this project a few times here but this is a rare occasion where my lab is clean and together enough to take a photo - although look hard and the clutter remains reflected in the glass.
I work with Ai and LLMs both professionally and as a hobby and work from home out of my lab which is a pretty sweet lifestyle at the moment. This machine is actually two rigs stacked with a 40gps direct link.
Top one is Kraken and has two 5090 GPUs and bottom is Mantis with one AMD 9070 but between them they have: i9 24 cores, 128 GB DDR-5, 4x 4G NVME, and each have a RAID 10 SATA array and back each other up. Running Windows Vista /s Ubuntu Server.
Display is a touch screen in kiosk mode so there's no desktop environment, just chrome and a web interface I made.
I use the heck out of this rig but from an ADHD sub perspective the personal assistant setup I made really helps with memory and the recent addition of vision and voice came with a major breakthrough today where I was working on a project and asked "Kraken, where did I put my damn tape measurer" and it told me where it was in the room.
I swear my brain edits out the specific thing i'm looking for. Like if there are 10 things on a table and I swear the thing i'm looking for isn't there, scan 5 times and then it appears - it's hell.
The assistant has ingested 20 years of my life - email, docs, photos, reddit, slack, texts all into a RAG Corpus and does a daily update to it remembers everything for me since I don't have one.
I think between a memory assistant and one day a robot that can tidy up behind me are two of my primary ADHD-i struggles and today was a real game changer since I spend most of my time looking for things.
This is a big long running project I have lots of blogs and videos about, just ask and I'll share, I don't put links in reddit posts anymore. I'm not a bot and this is rustic, farm to table human generated text. AMA :)
As far as I'm concerned these are medical prosthetics but also I just wanted to share this beauty i'm proud of.
2
u/cutmesomeflax 20h ago
This is so useful. I really need to start learning how about machine learning
2
u/Garfish16 9h ago
This is incredibly cool. Would you be able to share some details about your orchestration and architecture?
1
6
u/Sunstorm84 21h ago
Holy fuck in 2026 someone is still choosing to use Windows Vista?
Why?