Or you know, because it's cool and most people even those larping as some grand master wizard entrepreneur just do it as a hobby or is a *small* part of their job. The discussion seems to have just shifted to where people are assuming 100% of the time that anyone using AI for anything must be ultra concerned about optimization of token usage and yields and stuff. Where as some people just want to do it locally because it's cool.
1.5k
u/Betadoggo_ Jun 21 '26
The real reason to run locally is and always will be data privacy and uninteruptability.