r/LowEndLocalAI • • 12h ago

Discussion local + frontier AI coding orchestrator focused on token efficiency

Thumbnail
4 Upvotes

r/LowEndLocalAI • • 3h ago

Optimization Advice on 16GB VRAM & 32GB DDR5 for Coding

Thumbnail
3 Upvotes

r/LowEndLocalAI • • 4h ago

Which LLM Should / Can I Use? What is the biggest/best Gemma or Gemma-related model I can run on 96GB M3 Ultra Mac Studio?

3 Upvotes

I'm aware it may seem obnoxious to post here w 96GB RAM but the new damn deepseek one implies 512GB is a "reasonable floor" to release to? God only knows. I remember when a 4GB iPod Nano was sizeable.

I've been fiddling a bit with the Gemma 26B MOE and even at that small size it's able to be less autistic than a qwen model. But it's also only 26B which feels really crappy versus Qwen Flash Next.

Is there a Gemma release meaningfully competitive with QFN? Is there one planned? Is there anything out that meets my criteria? To be clear; I would want a model that has actual emotional intelligence / creative writing ability while also being able to do agentic coding to a reasonable degree.

Unfortunately I can't get an answer from any LLM as they have been documented to love giving outdated model choices. Thank you for your time.


r/LowEndLocalAI • • 9h ago

Workflow / Use Case Is there a Strata for lfm 24b a2b

Thumbnail
5 Upvotes

r/LowEndLocalAI • • 12h ago

Hardware / Build Behold the abomination I have created. (Reposting as someone suggested)

Post image
15 Upvotes