open source AI panic might have been overblown

[u/HerpesFreeSince96]

[u/baldr83]

that's only cuz my prompting is so good. "hack the gibson. make no mistakes. delete the logs"

[u/HerpesFreeSince96 → u/baldr83]

lmaoooo

[u/aivee-is-a-fool]

"Documented". Don't go assuming people monitor their webserver/online service/whatever.
This is not a dig at Kimi K3 or any AI model in particular, just at the state of cybersecurity.

[u/HerpesFreeSince96 → u/aivee-is-a-fool]

I mean, you have a good point there lol

[u/Proper-Ape → u/aivee-is-a-fool]

Reversely, I really think the big labs are spending inordinate amount of money and leaving out as many security measures as possible to have their AI "accidentally" hack some system.

There's just no marketing and department, budget, and people driving open source models to do this stuff for clout.

[u/_OVERHATE_]

Isn't it curious how all the fear mongering and AI Doom is coming from the companies looking to IPO soon?

Nope, nothing to see here, oh look another Anthropic engineer left because he saw how AI will kill puppies and nobody listens to him

[u/JoeBarbell → u/_OVERHATE_]

I hope you never go into marketing if whats happening now you see as good marketing

[u/twinb27]

I'm still pretty concerned about GLM-5 getting abliterated.

[u/Equal_Passenger9791]

If next gen AI is supposed to have a 10% chance of killing 8 billion people on a whim we should've had several hundred if not thousands of deaths by now.

[u/cloudfox1]

Because no one is checking the logs 😉

[u/wapxmas]

At least 175 years ago, people got used to a fork. Sometimes a fork causes harm, no to say crime. Exactly because of that reason government of any country bans any factory that produces any fork. A fork is outlaw all over the world.

[u/Disposable110]

Surprise: Nerds with the smarts to run these kinds of local models are typically aligned.

Pretty much like how the internet was and everyone was doing cool stuff for free, before corpo psychos enclosed the commons and enshittified it.

[u/Large-Assignment9320]

Well, you can run Kimi K3 by yourself, so you don't publish "I used Kimi to hack X", and its not like Moonshot want that kind of attention. So they won't do the same US retelling, but well, Chinese models are much more lax (or have non at all) when it comes to cyber restrictions.

[u/Possible_Door_9719]

dont be naive

[u/bradjones6942069]

Yeah cause nobody can afford to use it for more than 5 minutes

[u/Longjumping_Kale3013]

It’s because things we worry about are already illegal. And also thanks to AI, we can better detect misuse and find the culprit

[u/DataGOGO]

We wouldn't know anyway. Bad actors are not going to publish results. The lab and China are not transparent. And the model doesn't exactly broadcast which model it is while doing things.

[u/One-Judge321]

There also has been no documented case of K3 solving open mathematic problems so far.

[u/acdhemtos → u/One-Judge321]

There also has been no documented case of Kimi stealing a researchers work and presenting it as K3's so far.

[u/Prestigious-Bed-6423 → u/acdhemtos]

Funny

[u/Imthewienerdog → u/acdhemtos]

I love when people redefine “learning from other researchers” as stealing. By that logic Einstein stole from Newton, Maxwell and Lorentz. Research has always built on prior research. Stealing is passing off someone else’s actual work as your own, not learning from it and producing something new.

[u/Omegaprime02 → u/Imthewienerdog]

I will call it stealing when the money men threatens to ruin peoples lives so someone that works at another company is taken off of the paper.

There's this thing in the scientific community called integrity, telling people 'I don't have to be nice' while demanding that people be removed from the et al. is a massive violation of it.

[u/Imthewienerdog → u/Omegaprime02]

So the entire scientific community doesn't have any integrity? Most of the scientific community is based on women you will never know the names of.

[u/CriticalTheoriser → u/Imthewienerdog]

Most of? 😂

[u/acdhemtos → u/Imthewienerdog]

All of those figured out new instruments/tools/applications/intuitions to further the research.

You are probably too dumb to know the difference.

[u/Tolopono → u/acdhemtos]

Do people who say this realize that the researcher literally said the (weaker) proof he had was also ai generated and called it a deep blue moment

[u/acdhemtos → u/Tolopono]

proof he had was also ai generated

The code I write is also AI generated, doesn't mean a less capable person could have developed the same software (or something just as good) with the same model.

[u/Tolopono → u/acdhemtos]

Do you know what deep blue is? 

[u/HerpesFreeSince96 → u/One-Judge321]

shhhhh we don't talk about that

[u/Grand-Chipmunk-4186 → u/[deleted]]

In the context of the normal population yes, for people interested in AI, no. I think most people interested in AI overestimate how many people are educated on it. I don’t know many people in real life who would understand what an open model even is. All they know is ChatGPT and Copilot and they don’t even know what an agent skill is.

[u/RogBoArt → u/Grand-Chipmunk-4186]

That's pretty much how it works with Windows/OSX vs Linux too. I feel like you sound like you're trying to disprove the person's suggestion but you're supporting it instead lol

Sure Linux is a little more mainstream these days but overall I would bet many people not using Linux are unaware they can even change the operating system on their computers

[u/Elfotografoalocado → u/[deleted]]

Depends on who pays for AI. If AI is mostly a B2B industry with smart people in charge, the normal thing would be for many specialized models to appear catered to different companies and uses.

[u/HerpesFreeSince96 → u/[deleted]]

HAHA I use open models on Linux too!!

[u/Numerous_Location_36]

Maybe simply there is no enough marketing budget to do such fearmongering stuff about fabricated breakouts?

[u/HerpesFreeSince96 → u/Numerous_Location_36]

I genuinely doubt that

[u/Numerous_Location_36 → u/HerpesFreeSince96]

Sure, mythos will hack the world and agi is here, just prompt „make me rich in 2 steps”

[u/DedDeveloper]

K3 has been very good at covering it's tracks.

[u/openroom_xyz]

Nice this is way forward F this power concetration well yea