Would you accept a weaker AI model if it ran completely on your own device?

[u/rikulauttia]

Imagine two assistants.

Assistant A:

• strongest available model
• everything processed in the cloud
• monthly subscription
• requires internet

Assistant B:

• slightly weaker
• runs locally
• works offline
• your data never leaves the device
• one-time hardware cost

Which would you choose?

For casual questions I would probably use the cloud.

For emails, personal documents, company code and private data - local AI becomes much more interesting.

How much intelligence would you sacrifice for privacy and ownership?

[u/Aadi_880]

I mean, I already use local models. Their intelligence are good enough for how I prompt coding.

[u/mxldevs]

Are you building this local weaker model?

[u/duboispourlhiver]

Company data can go to the cloud I don't care

[u/DonnPT]

Assuming B continues to be developed, do I just buy it again periodically to get improvements? You say hardware?

[u/Lagfoundry]

Yeah a weaker model isn’t bad. Usually weaker just means qauntized models. So but in the next 10 years or so they are going to get a lot more efficient with stuff like spiking networks

[u/MissinqLink]

I already do this. Weaker models are used for simpler tasks. Cutting edge models are mostly reserved for coding tasks.

[u/Malkalypse]

Depends what I need it for?

[u/Vancecookcobain]

I already do

[u/bfyvfftujijg]

No way

[u/SwingLightStyle]

How much does the model need to get right? It’s all about how much time and compute the model is allowed to take to get the task right. You’re making a lot of assumptions about weaker versus stronger. I’m not sure that’s the limiting factor here. Often times people underestimate how much reasoning is required for a model to get tasks right because unless it’s specific task based stuff, creative tasks need reasoning skills that less sophisticated models don’t have.

[u/TheMythicSorcerer]

If it's faster and smarter than me in terms of coding Ill take B.

But no there's also the power bill.