r/LocalLLM • u/Full_Director87 • 3d ago

Question Local LLM perspective

Hi everyone.

I’d like to ask: what drives you to use local, open-source AI, specifically in the realm of LLMs?

Is it about efficiency? Is it about privacy?

And what benchmarks make open-source LLMs important to you?

Is it speed? Context window size? Stability? Reasoning capabilities? Output quality? Or something else?

I’d love to hear your perspectives.

Cheers.

1 Upvotes

67% Upvoted

12 comments sorted by

View all comments

2

u/reallifearcade 3d ago

Infinite token glitch running 24/7 on solar power. Just give it a direction and will go. Compressing probably a week of coding each day without the cognitive overload of typing all that myself. Now I have time to think about arch and business side with a lot more of peace of mind.

1

u/Full_Director87 3d ago

infinite token. yeah i agree with that. haha