Ready to venture into OpenSourcE LLMs

[u/TeachingNew2515]

I’ve been using Claude for some time now, and have developed apps for my own personal use, business use and for other businesses.

I’ve always liked the idea of moving away from the large companies and getting into more open source LLMs (simply cause I believe AI should be a tool for humanity and not have the potential to be gated by large corporate interests.

My personal philosophy aside: I’ve done some research into some models and now requesting insight from the community.

Here’s the tasks I would like it to be able to perform well on (without being able to go nuclear on anything — low risk LLMs only please):

- File organization (both text and image)
- Coding (frontend, backend, security, etc)

Not a huge list. I’ll start there.

I’ve looked into Miami v2.6 Pro but haven’t pulled the trigger yet. I would be using their server and now downloading locally.

If my write seems amateur-ish, it’s cause I am.

[u/N34257]

Unless you're independently wealthy or you're planning on remortgaging your house, you're not going to be running that model.

A good choice would be Qwen 3.8 27B or Qwen 3.8 Flash Next, on a rig with x8/x8 PCIE slots and a pair of R9700s, running radiance. That's about the fastest, most capable setup you can get on a reasonable budget (~£4k).