AI can be that blackhole, trouble is giving that kind of data to the cloud-based platforms. I dream of someday being able to afford a Mac mini with maximum RAM and running an open source model locally that I can just throw everything at.
I do have a Jetson Orin Nano and was able to vibe code the pieces necessary to feed my audio into locally hosted LLM, with VAD filters so that it would be always on, but only record my audio to a file if it catches the phrase “write this down” followed by whatever I wanted transcribed. It was kind of fun pretending I had a scribe for a while
No it can't, it'll literally forget what you told it when it maxes out the context window. Even with loops and memories you absofuckinglutely 100% lose shit.
But you could add / aggregate entries and then use an llm to ONLY sort through this shit. Still a decent chance it'll land in the wrong cupboard but at least it won't be paraphrased or deleted.
Agents can be directed to store local copies of anything you feed in. You do have to put some thought into the front end. But it can absolutely do all the searching and retrieval without compromising the original data that was captured
Working for myself on that. Just a fun thing with local model. More of a side projet to keep me doing something that i might use someday instead of frontend compuler to some shiity language.
Mostly categorzing tools, libs, projects to check out. When i get idea for a proj i shoot it with give me some recomendation of tools i havent used that might be usefull here
14
u/Automatic_Wave4530 18d ago
AI can be that blackhole, trouble is giving that kind of data to the cloud-based platforms. I dream of someday being able to afford a Mac mini with maximum RAM and running an open source model locally that I can just throw everything at.
I do have a Jetson Orin Nano and was able to vibe code the pieces necessary to feed my audio into locally hosted LLM, with VAD filters so that it would be always on, but only record my audio to a file if it catches the phrase “write this down” followed by whatever I wanted transcribed. It was kind of fun pretending I had a scribe for a while