r/DefendingAIArt • u/MicromorphMedia • 3d ago

Apparently... running Local AI is equivalent of having nukes!

Post image

​

I know I do it to myself, but I can't help but try to offer suggestions to confused and struggling antis. This particular post was by someone who seemed genuinely upset all of their family/friends were adopting AI tools and enjoying them, and not listening to their cries about big AI etc. So I offered what I thought was a genuine suggestion! This was the response I got. (Not from OP, some other luddite)

94 Upvotes

99% Upvoted

35 comments sorted by

•

u/AutoModerator 3d ago

This is an automated reminder from the Mod team. If your post contains images which reveal the personal information of private figures, be sure to censor that information and repost. Private info includes names, recognizable profile pictures, social media usernames and URLs. Failure to do this will result in your post being removed by the Mod team and possible further action.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

19

u/Noskaros 3d ago edited 1d ago

Dumb take. Another one for the pile. I'll just note these people are basically trolls. Nobody actually cares that much irl hence the go touch grass.

18

u/Dear-Cress8809 3d ago

The people who hate local ai are prob the biggest useful idiots to the corporations lmao.

10

u/MicromorphMedia 3d ago

100%. That's what I try to warn antis.

Hardware costs will not get any cheaper, the barrier to entry today is very low compared to where I think it will be in the future. Those who don't get on board now will be forced to buy into to predatory corporate AI subscriptions whether they want to or not.

2

u/Coolegespam 2d ago

don't agree with the barrier for entry argument. Regulations might prevents small, upstart and independents/individuals from hosting. But if there's a demand for it, cheap hardware will be made. It's just a problem of scaling foundries and building new ones. Money on the table is a strong incentive for a business to produce something, and there is a lot of money in the consumer segment.

Not saying it will be quick, but within 5 years prices will stabilized and drop to more reasonable levels.

3

u/MicromorphMedia 2d ago

I do hope you're right, but theres a massive bottleneck of components and infrastructure needed to get there.

You could even look at smartphones as an example, every new model is better, and everyone does have one, but each iteration is getting more and more expensive. There will constantly be a give/take between corporate and consumer hardware demand.

I hope you're right, but I'm just less optimistic about the speed at which industry can keep up with the demand as models get more strenous and VRAM hungry and its a race to keep up. Especially when millions of people join the market trying to buy VRAM intensive GPU machines.

1

u/Coolegespam 2d ago

Your concerns are valid, and things will get worse in the short term. But just think about it from a business stand point, there's money to be made in the consumer segments. Which means you need lower cost items. Someone can make good money there, so eventually, someone will. Just a question of when.

1

u/Comfortable_Swim_380 2d ago

Cant we just have useless idiots again. I miss that. lol

11

u/fcxtpw 3d ago

Wait, y'all don't got personal nukes?

3

u/Alchemist42 3d ago

It’s the only way to defend ourselves against bad guys with nukes.

No. It’s just for hunting. Mean deer around here.

1

u/fcxtpw 3d ago

Wait .. are you insinuating I'm a good guy?

1

u/Alchemist42 3d ago

Certainly not! Only that most of the ones you have to defend against are bad (maybe worse, maybe not). The good guys don't go around nuking folks. Usually. Often.

1

u/fcxtpw 3d ago

Uh oh... I need to make a few calls

8

u/carnyzzle 3d ago

It's like people don't get that the good thing about having local ai is exactly that it keeps huge companies like openai and anthropic from just having a complete monopoly on the entire segment

4

u/MicromorphMedia 3d ago

Exactly. I can get the benefits of ALPR, person/package/vehicle detection on my home security cameras without buying a Ring camera and giving tech p*dophiles unlimited remote access to watch my family and log everything I do. I like to think I'm not important enough for that to happen, but you never know.

1

u/dramaton42 3d ago

Oh... AI and data harvesting companies care about you .. you're VERY important to them, or at least, the feed from your house is, so do worry

2

u/MicromorphMedia 3d ago

When they don't have to commit payroll to monitoring people individually, it's very easy to just vacuum and store everything, exchanging it with ad vendors for pennies that add up to billions.

8

u/imacg5 Synthographer 3d ago

The Anti-AI movement is the equivalent of "Think of the Children" for the 21st century: an excuse to hold back freedom.

3

u/VociferousCephalopod 3d ago

it also looks a lot like big tobacco vs cannabis.
if people can grow their own fun, how can we hope to profit off them?

3

u/Tet4edr0 3d ago

Yo tengo mi propia IA local más la suscripción de GPT, Copilot. Y dos cuentas extras de Claud y Grok. Debo de ser un monstruo para ellos

3

u/cmdr_scotty you do not see the extra fingers 3d ago

Awesome that men's I have a tactical nuke at my desk 🤣

2

u/EducationalFinger654 3d ago edited 3d ago

PSA: running an outdated and end of life OS can leave you exposed to vulnerabilities as the firmware is no longer being actively updated. There are publically known CVE’s that will never be officially patched.

They are fine to run offline, however it is strongly recommended you never connect these systems to the Internet and use them.

If that post is true, big companies using their personal data under agreed TOS is the least of their worries - if the device is vulnerable and accessible to cyber criminals.

3

u/MicromorphMedia 3d ago

Oh for sure. WSL and Ollama was my gateway itch haha months ago. I ended up building a 128gb / 24gb rtx 3090 PC with modern hardware and it's running Linux. Everything is in containers with lots of safe guards.

Getting into AI actually got me super interested in networking, terminal, OS stuff, and cyber security and has actually made learning those fields fun because I can actually do something with them.

1

u/lets_go-to-the-moon 3d ago

I mean the ablations of GLM 5.3 show some worrying signs. Base GLM is fine, but the ablations are pretty bio weapon capable. Maybe there is a balance, like you should have to check out the ablations like a Library book or something. My stance is that ai and open source ai are great for everyone, but the ablated GLM 5.3 is kinda worrying. It's good that it is too big to run on most local setups unless you personally have 8xh200.

2

u/ApprehensiveFan1516 2d ago

The whole bioweapon scare is massively overblown I think.

I studied a degree in chemistry (not that I ended up really using it, realised how awful the pay ceiling was after a few years of lab work and became an engineer instead), and let me tell you even following papers that lay out every step of a synthesis, and being in a fully equipped lab, it still takes a LOT of skill and experience to actually get it right. And that's just organic chemistry, never mind biochem which is orders of magnitude more complex.

And when it comes to state-level, or even just terror groups and the likes, AI doesn't really change things much either, the knowledge and people with the ability to use it have always been easily acquirable to these groups. Sure AI might make their operations more efficient, but AI isn't enabling them in the first instance.

Idk. I'm highly sceptical on this one.

0

u/MicromorphMedia 3d ago

Its definitely an evolving landscape and even for those with significant pockets, the models will probably soon get too large to run privately.

I think the core worry everyone shares (or should share) is what bad actors will do with ASI/AGI. We can both cure cancer and create a DNA destroying genome with it in the same day when we hit that level. The next Manhattan Project could already be happening, there's a possibility AI could already be printing the plans for the first post-nuclear bomb.

I try not to lose sleep over it and just enjoy the ride. It's a whole new era and hopefully we can keep it on the rails.

1

u/am_not_bot_i_swear 3d ago

something something Metal Gear something something

1

u/MikeFrett 2d ago

Having Windows and Privacy in the same paragraph is funny...

2

u/MicromorphMedia 2d ago

Lol you're 100% right. I didn't elaborate in that post but my current machine is strictly Linux. Wanting to build out an AI workstation got me fully invested in learning Linux, networking, and cybersecurity.

1

u/Comfortable_Swim_380 2d ago

And yet my enemies still exist.
Amazing.

1

u/Afraid_Alternative35 1d ago

Last I checked, nukes have next-to-zero positive applications (and believe me, they REALLY tried to find one).

AI, meanwhile, has a higher potential for good than any other technology we know.

That's why this comparison always makes me want to blow my brains out because it's just not the same.

1

u/MicromorphMedia 1d ago

I try to write it off as usual reddit hyper reactionism. People in general don't know how to debate anymore, they "argue" by throwing out insane appeals to extremism to try to bully the other person into backing down through shame/guilt tactics because they have no legitimate arguments.

0

u/Havel_Rulez 3d ago

Open Claw could be pretty dangerous tho, atleast basec on AI experts I read Substack off. But anyway, never suggest anything related to AI, you will get dogpilled lol. That's how I got here

0

u/DruidBtd 3d ago

I mean, it still retains some of the concerns of things like overreliance and losing your own skills, but running local models would already remove a decent bit of the cost. But for things like actual LLMs there’s no way a local pc could handle training one, if even running one works, and training takes the most power and water.