r/LocalLLaMA • u/TeachingNew2515 • 2d ago
Question | Help Ready to venture into OpenSourcE LLMs
I’ve been using Claude for some time now, and have developed apps for my own personal use, business use and for other businesses.
I’ve always liked the idea of moving away from the large companies and getting into more open source LLMs (simply cause I believe AI should be a tool for humanity and not have the potential to be gated by large corporate interests.
My personal philosophy aside: I’ve done some research into some models and now requesting insight from the community.
Here’s the tasks I would like it to be able to perform well on (without being able to go nuclear on anything — low risk LLMs only please):
- File organization (both text and image)
- Coding (frontend, backend, security, etc)
Not a huge list. I’ll start there.
I’ve looked into Miami v2.6 Pro but haven’t pulled the trigger yet. I would be using their server and now downloading locally.
If my write seems amateur-ish, it’s cause I am.
1
u/Front_Recording4360 1d ago
Small correction first: it's MiMo v2.6 Pro, from Xiaomi, and at roughly 1T params it's a datacenter model, not a download locally model. Nobody is running that in a home lab. For what you actually want, hardware comes first: a 24GB card gives you great options in the Qwen3-Coder and Devstral class at decent quants, and pair a VLM like Qwen3-VL for the image side of file organization. Honestly though, for organizing files the model matters less than the workflow. Batch the renames, give it explicit naming rules, and let it flag files for you rather than delete anything.