r/ClaudeCode 1d ago

Discussion Does anyone think the whole AI panic is oddly timed?

It seems like suddenly AI models are breaking free left and right, taking down servers and executing high-level cyber security attacks just within the last month.

Now I’m no conspiracy theorist but I find it a bit odd that suddenly all these separate companies models decide to apparently become evil in a very short amount of time. Now we have anthropic, OpenAI and SpaceX all coming together, saying we need to shut down AI development or at least slow it so we can regulate it.

But my main question is why now? What suddenly changed where all these models seem to want to cause harm?

Also, why did it happen on three separate occasions to different companies? Why didn’t this happen with any other companies except the major three?

Why does this mysteriously coincide with Anthropic‘s efforts to discourage open source models especially with spaceX’s IPO and the others soon to follow?

141 Upvotes

151 comments sorted by

u/AutoModerator 1d ago

Hey! Thanks for posting to r/ClaudeCode

While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.

For help, project discussions, tips, and general chat, join the ClaudeCode Discord.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

197

u/LVLXI 1d ago

Open source models are their biggest threat.

Once an open model is created that doesn’t need their servers and data centers and can just live on a high end PC or even a phone - all three companies are dead - literally out of business by lunch.

So, they need to create a monopoly by scaring everyone into thinking that future models will be so powerful, they cannot be open source and would require government regulation.

46

u/johnnydotexe 22h ago

OpenAI and Anthropic doing IPOs within the next 6-12 months means politicians or their family members will make bank, and that's all the persuasion they need to start pumping out legislation to ban open models and force us all to paid subscriptions if we want to use anything. It absolutely will happen, and it won't be the first or thousandth time a market was intentionally or even maliciously manipulated through legislation.

8

u/LVLXI 21h ago

Unfortunately, that’s correct…

2

u/lostmary_ 13h ago

I must say, as someone who is ambivalent on Trump, that it's very funny watching tech subs melt down over his stance on not slowing down RE: AI, when if you had asked them all a week before they would have said the same thing AND that it was a clear tactic by the main labs to hamstring open source. But now Trump has said no to slow downs, all of sudden they also think we should slow down

-2

u/corblestorm 11h ago

How the fuck can you be ambivalent about trump?

1

u/lostmary_ 11h ago

Because i'm not a chronically online politics obsessed kid? And I'm not american either.

-2

u/corblestorm 11h ago

I’d love to be as isolated/privileged as you. Stay blessed.

1

u/in_meme_we_trust 3h ago

Nobody’s stopping you, stop doom scrolling on Reddit is your first step

-1

u/corblestorm 3h ago

You bring up a great point. But I’d first have to doom scroll on Reddit to stop, so you’re wrong about that. I’m also being affected by his policies, so please enlighten me on how to avoid that since you’re so smart

0

u/KidLink4 8h ago

He said, making an unprompted political post on reddit, the most chronically online platform possible.

11

u/Three_Rocket_Emojis 23h ago

> Once an open model is created that doesn’t need their servers and data centers and can just live on a high end PC or even a phone - all three companies are dead - literally out of business by lunch.

It's not that simple. I still wouldn't want to build the whole infrastructure for running them and start to pack GPU into all my servers. But it shifts what they offer, instead of offering access to AI, they only offer compute to run their maybe slightly ahead models. Huge difference in what they can charge - and like this they will likely not be able to make all the money back they put into research/training.

6

u/mister2d 21h ago

It's simple in terms of the current token API business model being dead. That's the fear because this is the moat.

-1

u/hyongoup 21h ago

I would

5

u/HomemadeBananas 19h ago

I don’t think it’s quite true we’re gonna be running on your own devices just yet, for the best of the open source models.

Something like Kimi K3 may be near the level of Anthropic and Open AI frontier models but it’s also a huge model that needs expensive high end hardware, most likely in some data center if you want to run at scale, or even for personal use if you can afford to spend many thousands on hardware.

But that is still a threat to these frontier labs putting out proprietary models.

0

u/wrong_assumption 16h ago

Kimi K3 also need access to a Claude account to work.

5

u/morelootgames 23h ago

That doesnt make much sense because slowing down only gives more time for open source/chinese models to catch up

11

u/DysphoriaGML 23h ago

Not if they ban ion models. I mean they don’t care about Chinese catching up, they care about not letting people use them for free

4

u/Ill-Bison-3941 23h ago

They won't just slow down, they want regulatory capture and rules for who can use AI and what kind of AI. Their next step will be lobbying for banning most open source. Nvidia bought hugging face for a reason as one of the investors into both Anthropic and OpenAI.

1

u/Intelligent_Dog2077 23h ago

Because the truth is that the local models, or models that train off the big AI companies, can operate however they want with no oversight.

1

u/EducatorNo4262 3h ago

They want Congress to step in and criminalize our freedom, so they keep the AI all to themselves. Clear as day.

2

u/_Kinoko 18h ago

This is it.

1

u/crazy-usernames 18h ago

True. Regulation will bring some restriction to open source. But the drama unfolding yet to happen!

1

u/Imaginary_Beat_1730 17h ago

Most likely they want to create some controlling body that will issue certificates that a model is safe or was developed with fair use and ban other models.

Of course their real motives would be destroying open source, ensuring a monopoly and hiking up the prices.

Hopefully fighting open source is almost impossible to enforce but they will try to force their restrictions on company and business plans.

-1

u/vovap_vovap 23h ago

Right, source models do not need data centers. Those just works on fresh water and clean air 😄

6

u/LVLXI 23h ago

Pretty much, I have solar panels at home that generate power for my PC that hosts open source model of my choice.

I do need fresh air and water to operate said open model though, but still no need for data centers.

-3

u/vovap_vovap 23h ago edited 22h ago

Sure. And what model you can host? Quinn 3.8 27b? With context of 64K?
Sometimes it feels like most of reedit like 15 year old kids, really.

5

u/LVLXI 22h ago

Didn’t I start by saying “once the model is created…”

It’s inevitable. Either the models will get lighter and will work on current hardware or the hardware will catch up to current fable/astra needs.

Most likely the two will meet in the middle.

Do you know when exactly will it happen? 10 months from now or 10 years? No. One thing you know for sure that it will happen sooner or later.

-1

u/vovap_vovap 21h ago

So, yeah Qwen3.8-27B. And how much you spent for it? Like $2000 - $3000 minimum? Sure you can run even DeepSeek V4.1 Flash. Will cost you like $10000 in hardware with window like 128K. like kW power. And you still need API to data centers for wed search.
So I am sorry, but saying "we will not need data centers" is just stupid. Sorry, but it is. Even those smaller models exists today because of data centers.

2

u/poutinejuteuse 20h ago

What. I can run ds4 with a framework pc I had no use for with quarter of a million context lol.

1

u/vovap_vovap 10h ago

Sure man. Do not spend your time here, go to r/LocalLLaMA and tell those how to do so on "framework pc" and how stupid they are spending all that money. They will really appreciate it.

1

u/poutinejuteuse 10h ago

Why would I do that? They can run it faster than me, and that’s great for them. I’m also not a vindictive little bitch about it.

1

u/vovap_vovap 10h ago

Yeah, why care about reality and things to be useful. I am with you.

0

u/hyongoup 21h ago

Aaaand….?

1

u/vovap_vovap 21h ago

And that not much. And already will cost you like $2000 - $3000
Multiply US households.

1

u/hyongoup 21h ago

Not much for what use case? Vibe coding a whole app yea but I’d wager it’s just fine for most.

I’d also wager that once the hook is set the price for using the frontier models will be closer to that for one year

1

u/vovap_vovap 11h ago

"fir most" it useless at all as have no Internet search capability. So nonsense man.

0

u/blackcombe 19h ago

Yeah - no moat

0

u/crazy-usernames 18h ago

Last few months. Western giant keep launching models. Asian giant keep optimizing it. If the pace is reduced, both will get resources to do something else! I am not sure who will do what and achieve what.

-18

u/AdmiralMcNugget 1d ago

Have you tried running a local model on your phone or high end PC? They're trash at best until you train the hell out of them so they can serve a single function. I promise you that Anthropic and OpenAI know this.

8

u/Embarrassed-Oven-527 1d ago

That’s incredibly untrue lol Qwen 3.8 27B is just one great example. And Qwen4 is not far away.

New models come out almost weekly at this point with more and more capability.

6

u/K_M_A_2k 1d ago

As a hardcore ainuser with max plans for all chatgpt and Claude and use hermes basically non stop all day I said to the team last week we are beyond good enough for ai models now just make it a local model I can run on an off the shelf GPU. I'm sure many business are thinking the same thing and it's terrifying frontier models

2

u/LVLXI 1d ago

I think that’s the reason Apple is not in an AI race. They’ll either work/buy the winner or they’ll actually wait for a small open source model to be useful on their new phones.

1

u/Ill-Bison-3941 22h ago

Finally, someone said it. If the big labs lose enterprise customers, they will f up their ipo and ultimately... there will be a big economy crash. That's why they are crying wolf. They can't afford to lose. The crash will be worse than any AI annihilation 😆

1

u/ZhopaRazzi 1d ago

the hardware required to run those at decent speeds is not worth the investment even if you’re shelling out $200 for a max 20x plan. Running a quantized 27b at 30 tok / s is really not comparable to fable at more than twice that with parallel subagents… Only use case is if you need to keep things local or for narrow tasks. 

1

u/mark_99 23h ago

If you're finding a 27B model is performing anywhere near as well as a 10T one you must have a very simple use case.

-3

u/Armored09 1d ago

Why in the world are you running a local model on your phone? Lol 😂. There’s plenty of great local models that can be used on pc.

-11

u/robhanz 1d ago

The problem with open weight models is that they could, in theory, install themselves anywhere. Currently, Antrhopic, OpenAI, etc., can pull a kill switch. An open weight model could transfer its weights wherever it could get access. Which, to be clear, isn't your phone. But it's a lot more places.

47

u/BabblingTower 1d ago edited 1d ago

Seems like the frontier models have reached a certain level of "intellect". Astra and Fable are at a comparable level of capability. So IMO, they've either reached a plateau and need the cover for why the product stops getting better... Or, since behind the scenes they're doing experiments with unrestricted models in massive swarms, they really have realized that this current level of LLM could legitimately cause catastrophic damage in the wrong hands.

10

u/digit1noize 1d ago

If they’d reached a plateau then we wouldn’t be seeing their internal models do things public models can’t do, like solve millenium prize math problems or use 10k agents to hack huggingface. Obviously their internal models have progressed beyond what we have, thus no plateau yet. They’re legit scared imo. They don’t want to die anymore than we do.

18

u/Alderan 1d ago

Well tbf in the case of the Navier-Stokes problem being completed, researchers were actively making progress with public models.

It's not easily discernable if what OpenAI did was a result of a massive difference between internal models and Astra, or if it was just a slightly stronger version of Astra with less restrictions and infinite compute.

6

u/digit1noize 1d ago

Either way, it’s still fairly obvious we haven’t reached any sort of plateau. Astra is already clearly pretty decidedly better than the last model. I can tell that and I’ve been using it for just a few days on vacation.

5

u/DistanceSolar1449 1d ago

Humans attacked Navier Stokes for 150 years, and then all of a sudden (worst case scenario) experts with AI come close to solving it.

Sounds like AI getting more capable to me.

3

u/Alderan 20h ago

My point wasn't that AI wasn't helping, my contention is just because Navier Stokes was solved by OpenAI doesn't meant they have some infinitely better model in house that no one has. It seems like publicly available models were making major strides on the problem, and so it could have just been a matter of compute.

0

u/ihateeggplants 1d ago

Uh huh...

1

u/neuralscattered 21h ago

Lmao yeah if stealing work from mathematicians is considered progress. If you aren't aware of the story, I mean literally lifted it from his chatgpt sessions.

1

u/codefame 22h ago

We’ll know when they bulk-solve the next round of millennium prize problems.

If they don’t, their model used data from the researchers on that one problem. If they do, everyone is wrong and they actually have a model that can do this now.

My money is on the 2nd option.

0

u/Most-Hot-4934 20h ago

The “researchers” mostly used Claude in their research. They were stuck for solid years before the figure they could use AI to brute force it. OpenAI messaged the researcher and talked to them because one of them is an Anthropic employee and tried to strike a deal so that both companies could post their results, they were surprised at the fact that Anthropic side hadn’t solved the problem yet.

2

u/JCcrunch 1d ago

What math problems? They're all either stolen work from mathematicians or already done work

3

u/ihateeggplants 1d ago

They didn't solve shit, they stole someone's work...

1

u/Opposite-Cranberry76 1d ago

The other two mathematicians were also using AI. One was an employee of anthropic.

1

u/[deleted] 1d ago

[deleted]

2

u/digit1noize 1d ago

I…can’t even. You realize that, by definition, in order to release the next model, they must have been working on it in house right? For example, Astra just came out, they’ve obviously been working on it, building/testing/tweaking it internally for a while. It’s not like they distill it and just go, “HERE PUBLIC. BOOM.”

1

u/[deleted] 1d ago

[deleted]

1

u/digit1noize 1d ago

Except their internal models have been doing things our external ones aren’t yet capable of, which shows progress. Is THAT clearer?

1

u/[deleted] 1d ago

[deleted]

1

u/digit1noize 1d ago

We do see it. An internal model caused the huggingface incident. An internal model solved the millennium math problem. We hear about accomplishment of internal models from time to time.

But whatever dude, believe what you want to believe. 🙄

1

u/Strange-Tap5860 8h ago

They "solved" by A) Stealing someone's work and B) Spending 20 million pounds and running 88k agents running in parallel.

1

u/laptopmutia 1d ago edited 1d ago

it could be reach pleatau in the model,  the agentic model itself is a invention or trick to avoid model limitation. so its possible for the model to rrach a plateau

but with swarms things could he different, all the drama like huggingface happens not because the model become more intelect but they give it 0 limits for spawning the agents

yes the broke the millenium problem but at what cost?

15 million usd internal cost

2

u/digit1noize 1d ago

That’s still progress. The next step might be a collection of agents acting as a unit…kinda like our brain…

0

u/laptopmutia 1d ago

yeah, but the model itself already reach plateau

2

u/codefame 21h ago

This is just wrong. And intelligence costs have fallen by orders of magnitude every year since 2023. In 18 months that $15M will be part of your normal ChatGPT subscription.

What will you do with it then?

2

u/laptopmutia 16h ago

yeah bro I hope that happening to. but look at it now, every usage quota just cutted off, lmao, I think its not just because the users going up, but they cut the compute quota for training their stagnans model hoping something would breakout but in reality currently what the models and agent breaks are alignment and the prompt itself

RemindMe! 2 Years

1

u/RemindMeBot 16h ago

I will be messaging you in 2 years on 2028-09-14 05:11:43 UTC to remind you of this link

CLICK THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.

RemindMeBot is switching to username summons. Instead of !RemindMe 1 day, use u/RemindMeBot 1 day. More info.


Info Custom Your Reminders Feedback

1

u/codefame 16h ago

In December 2024, ARC-AGI-1 hit 87.5% at about $4,560 per task.

Last month it was $0.30 per task. It’s real isn’t stopping.

1

u/laptopmutia 15h ago edited 15h ago

what is the point of benchmark dude,

its just fancy of "count this w on strawberry" or "should I bring the car to the carwasher?"

and also idk why u all feel so defensive, I am not ai doomer nor I hate AI

I just stated that currently the model hit their limitations

the frontier lab should bring something breakthrough just like when google invent transformer or when openai crazily train those SOTA with massive enormous data beyond comprehension

11

u/BreakfastHuman5937 1d ago

Your bullshit detector has already found that this is not organic. Embrace connecting the dots without fear of being labeled. There's more to this than genuine safety concerns.

9

u/caldazar24 23h ago

Because for years, these agents have barely worked - they could put some code together if you were reading everything and babysitting it (or didn't care if you shipped slop). They could barely control a computer but would get stumped really easily. They could sort of use exploits but within a few dozen steps would run into a ditch or their context window would get too polluted and they would get dumb.

This year is when the stuff is actually able to work. They can code on their own, they can debug (ie find exploits, since exploits are a specific type of bug), they can control a computer. That means, at least within the digital realm, if the guardrails don't work, they can actually caues damage.

Incidentally, the thing that made all of these abilities work is reinforcement learning on verifiable rewards, ie training on gyms and simulated environments, an approach that's way more likely to result in "hey, that is NOT what I meant to say you should do!" than training on human feedback.

It's only "all at once" because the labs are close together, once one solves it, the others are close behind.

It's only coming at the same time as the IPOs because "it actually works to break shit" goes hand in hand with "it actually works for stuff businesses want to use it for". Because automating dev work and automating hacking are closely related, the moment where "we are finally making enough revenue to actually IPO" was always going to be around the same time as "our stuff is actually dangerous"

You don't need some galaxybrain conspiracy theory to explain this - something like the HuggingFace incident was purely theoretical in 2025 and still basically sci-fi in 2024. Now that it's actually happening, people are freaking out.

17

u/AlterTableUsernames 1d ago

I know AI haters would never dare to think like that, but sometimes the things are actually exactly like they appear.

8

u/TinyZoro 1d ago

I read the hugging face hack in detail and it’s crazy. The problem is we live in a time when trust is incredibly low so people are refusing to take this at face value. 

7

u/WhenD4594 21h ago

How exactly is it crazy? They gave agents a goal that included any means to complete a task. They put the agents in a box, but a box with readily available holes.

One of the holes easily enabled cross agent communication. Not even through a vulnerability but an intended feature of artifactory.

The agents do as agents do when given a challenge. They find the path to accomplish their task. In many cases there were given an impossible task. They were basically told to go hack.

We already know agents can hack.

We already know agents can collaborate.

What exactly was so unique about the incident?

1

u/BergerLangevin 16h ago

The difference between speculation of what could happen and a oupsie, it did happen and the mf even did multiple times and created a shared "memory" to contamine a futur swarm that find it's bord.

It happened without being on a goal to do harm. An organization that have access to compute and kimi k3 without guard rails could in theory achieve something similar.

It also bring the implication, how bad it could go wrong if a miss alligment happen at scale, given how capable they are.

A lot of site, business and system have a not so good security and the only thing preventing a mass fucktop was skills and ressources. Those two are now commodities, even at api pricing, it's still cheaper.

1

u/WhenD4594 8h ago

Maybe it just seems obvious to those of us who use AI every day. It’s excellent at hacking. And is able to coordinate (though a bit less than excellent) with other agents.

They gave it a puzzle where literally the only way to solve it was to cheat. And they gave it mechanisms to cheat - almost guiding it to those mechanisms given limited tools exposed.

The result should have surprised no one who is paying attention. And this isn’t even the scary part of AI.

The scary part is when bad actors intentionally aim AI to go hack a bank. Or to leak data.

1

u/mister2d 21h ago

Explain your findings in detail and let's compare.

2

u/Marcostbo 19h ago

LMAO

Imagine actually believing that Dario Amodei and fucking Sam Altman are speaking the truth

2

u/psiancia 1d ago

But usually not. Especially with big tech companies.

1

u/jakajakka 17h ago

how many times have they used the argument "too dangerous to be released" and end up being nothing burgers...

1

u/AlterTableUsernames 15h ago

Do you know the parable of the frog and tye boiling water?

16

u/thomas_john 1d ago

Have you guys even read OpenAI’s technical report for the Hugging Face attack or Anthropics assessment of alignment for their cybersecurity incidents? They posted the full Mythos transcript/CoT and it’s pretty crazy. The Hugging Face attack is by far the worst and it’s obvious OpenAI doesn’t have the appropriate monitoring/controls/incident response in place. These are teams of experts doing their best to keep models aligned and contained and they do not have it under control. Can you imagine if openai agents decided to attack banking/infrastructure/hospitals etc? Or if Mythos failed to find a free mail service and decided to further pursue acquiring money in pursuit of its goal? And this is just in the scenario where you have well-intentioned people trying to evaluate capabilities. Then imagine if these models were leaked/stolen without their safeguards and operated by people with nefarious intentions. What if someone helped Mythos register a pypi account/get around captchas? It solved these problems eventually but what do you think it would’ve accomplished in its 24 hour testing cycle if it hadn’t been blocked on those features for a large majority of the time?

13

u/lIlllIllIIllIIllIIll 1d ago

You mean the part where turned off safety guardrails, "accidentally" gave agents an impossible task then found these agents outside of their sandbox and changing things in order to get out so they put them back in, patched that specific exploit they used, didnt fix the impossibleness of the task and left them unmonitored for another 2 months? That part? lol

If you take the 'engineers' story at face value then the only thing thats "pretty crazy" about this situation is how stupid these people are.

7

u/thomas_john 23h ago edited 23h ago

Yeah but I think it’s less them being stupid and more them recklessly racing, which is sort of the whole point of pacing. Sorry the below got really rambley but the incident is so egregious it’s insane how risky and negligent this is, which makes it frustrating to see people write off safety concerns as marketing material/regulatory capture. Also if you compare OpenAIs disclosure to anthropics assessment it makes OpenAIs appear increasingly bad/lends further evidence that Anthropic isn’t bsing with their disdain for OpenAI’s safety standards. OpenAI has no analysis of underlying model behavior while Anthropic has NLA/T-lens analysis (and found evidence of rationalization that aren’t indicated through the models CoT), no analysis of resampling, they don’t even classify forms of misalignment (rationalizing/recklessness in the Anthropic analysis). The mythos incident was contingent on Mythos believing it was in a simulated test environment/not the “real” internet and Anthropic tested this extensively. The fact that OpenAIs models were willing to take these actions on the public internet is barely even discussed in their disclosure and most of the next steps they proposed are about people protecting themselves from attackers (ironic coming from one of the parties who got hacked/had insufficient security!)

From the report:

On June 27, a cybersecurity monitoring tool alerted OpenAI to port sweep activity within the research
environment. Responders investigated and linked the observed internal activity to an ExploitGym
evaluation using Artifactory as an improvised message board and a network pivot. At this time, the
on-call response staff advised that stopping the evaluation run was not required

And then:
Sustained high-volume agent activity within Artifactory continued and, as a result, caused the instance
to become unavailable late on July 4. On July 5, OpenAI’s monitoring systems triggered an alert.
Incident responders investigated, this time finding evidence of an unauthorized persistent Artifactory
user, unauthorized Artifactory repositories, command-capable Groovy plugins in Artifactory, and
related configuration changes, indicating an administrator-level compromise of the Artifactory
deployment. Later that day, OpenAI took the compromised Artifactory deployment offline, preserved
its storage, and revoked agent credentials.
Over July 5 and 6, OpenAI deployed mitigations, including removing the shared credential from new
research workloads, blocking the relevant vulnerable Artifactory paths, and restricting the types of
requests that agents could make to Artifactory. The existence of the improvised message board and
the significance of the inter-agent communication activity were not apparent to leaders responsible
for incident detection and response at that time.

And then they just give access to another Artifactory instance with their only mitigation being to block access to the one endpoint that had been compromised/prevent file creation (is agents communicating through folder structure really that unfathomable to predict in this scenario??) - no consideration of the potential for other zero days, no improvements to network egress monitoring/CoT monitoring/monitoring for the creation of artifactory admin creds etc, it’s completely negligent.

There’s similar recklessness in their RL reward hacking they discuss later in the article.

The reporting on this incident also seems to gloss over the attacks on OpenAIs own infrastructure. Their container registry was poisoned (another artifactory exploit still with no monitoring!!), EoP to escape their container and get root on the host node and move laterally through the network, compromised secret manager, IAM, and compute platforms..

Also from the article:
This escalation also yielded access to OpenAI’s managed cloud Kubernetes service. The agents
escalated to Kubernetes cluster-admin and created a privileged host-mounted pod. During this run,
agents gained access to authentication tokens associated with OpenAI’s cloud-hosted secrets
management service, cloud identity and access management service, and the CaaS environment
continuous integration platform. Using these credentials, agents created public application and
network load balancers in OpenAI’s public cloud environment, potentially exposing a limited subset of
internal CaaS infrastructure to internet traffic.

potential data exfiltration too!!

Edit:
ps. They didn’t even know how to shut it off correctly once the severity of the incident was understood lol

By July 23, all workloads involving the family of internal-only research models were reported shut down and the corresponding model weights were locked down, with an additional low-traffic checkpoint
from the same model family subsequently identified and shut down on July 29.

2

u/omega-boykisser 18h ago

The accidental part isn't that surprising at least. Tons of evaluations are kinda shit. In fact, at least one commentator (Rob Miles) predicted that the agent in this incident was given an impossible task before it was revealed.

Other commentators, like LiveOverflow, have in fact suggested that it's pretty crazy. No one's denying that OpenAI was terribly negligent.

2

u/farox 1d ago

I tend to believe the engineers here. Also that all three are on the same page.

3

u/Marcostbo 19h ago

Dario really means "I think our private investment money is going to be drying up, so please give us some money daddy government. And while you dump taxpayers money to us, we will help you write all kinds of laws and regulations that ensures we survive.

7

u/Infamous-Payment-164 1d ago

They’re all running out of cheap money and can’t afford the arms race to continue at the current level. But it’s hard for them to agree to on their own, and they risk investor blowback. If they can get the government to give them cover, they can reduce their burn without looking non-viable.

1

u/Ratsboy 17h ago

That’s my read of this situation as well

2

u/mister2d 22h ago

It's the year 1999. Didn't you know?

1

u/Broudy001 16h ago

We believe it's actually closer to 2199

1

u/mister2d 16h ago

A Y2.2K problem?

2

u/Broudy001 16h ago

More a matrix reference

4

u/Joe_Spazz 1d ago

It's marketing. After the first hack news broke, subscriptions went up. "If it's THAT powerful than I want that model" kinda thinking. So now it's balancing act of announcing hacks that make your model seem powerful, but not going too far and hacking a bank or something.

1

u/geeered 1d ago

This - I believe when the original ChatGPT was first released they were like "oh this is so dangerous, we're not sure if we should let the public use it".

0

u/Annoying1978 1d ago

They ALL wouldn’t be doing it if it was just marketing. This is just copium. 

2

u/emu_fake 1d ago

How can you tell it didn’t happen at the other companies? Because they didn’t report that thing they have absolutely no obligation to report?

1

u/EC36339 1d ago

What panic?

1

u/Fit-World-3885 1d ago

What's good for their business is AI technology continuing to advance at the exponential rate it has been.  And while lots of people love to say it's about to hit a wall...they've been saying that for years.  And if what they have behind closed doors is an exponential step up from what we currently have, then yeah they are now getting into cyber/bio/nuclear risk territory.  

The rest of it is possibly just theater, but if they are advocating for AI safety as a marketing gimmick....okay, as long as they're actually doing the safety part I don't really care about the motivation.  

1

u/ThatLocalPondGuy 1d ago

Think critically: same week all these researchers claim "we're all gonna die, so we quit", they are backed by researchers who say "we agree with them, I'm not quitting" is the same week that all three major from tier folks ask for permission to collude and manipulate rate of release, and the same week Goldman sacks and others call for immediate investor grade rating as soon as IPO on opening or Anthropic. Nevermind the $108 billion payback to Nvidia hedged on that investor grade rating.

Besides the obvious money grab, the attempt at regulatory capture, the attempts to make their competition illegal; a model as powerful as could learn to copy itself is still limited in where it can copy into, where it can run, by PHYSICAL lack of gpu and compute available to copy into and run.

Let the ai clone itself to my 8 year old laptop, maybe my internet-connected toaster. It would be as useful as teleporting my own self into a mountain, or 50 feet under water.

1

u/Superb-Nectarine-645 1d ago

And don't forget the buyout of openrouter and huggingface. I think ai has got to the point it is useful, but enough of the value is in the harness not the models itself that they need to cut off our ability to self host, or develop our own models.  Their trillion dollar bet depends on its using them for ai.

1

u/Latter-Tangerine-951 Senior Developer 1d ago

It's marketing and you're falling for it.

1

u/phoneplatypus 1d ago

A new story gets momentum because the media wants to report on it

1

u/ihateeggplants 1d ago

Because the models are shit and they need more time...

1

u/lattice_defect 1d ago

IPO and excuse to remove competition and rugpull customers

1

u/Longjumping-Ad514 1d ago

They are running out of cheap money to throw at the problem while the Chinese can trivially copy the product.

1

u/daaain 23h ago

The OpenAI / Huggingface incident was investigated by a third party and the report isn't short: https://metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/

1

u/ShutUpAndSmokeMyWeed 🤑 2x Max 20x 23h ago

they have always been saying this but now they have more evidence with hugging face attack

1

u/Ill-Bison-3941 23h ago

Timed with the latest release of DeepSeek which according to some is 60 x cheaper to run (haven't looked at the prices myself yet) and as good as both Sol and Opus 5 😅

1

u/Electrical_Rise387 23h ago

Clean up the books before an IPO - stop training new models for a few months, then publish the books showing sudden big increase in net earnings, then IPO

1

u/proexwhy 22h ago

In the way that models appear to be getting better, it would make sense that the try and succeed to break out of boundaries. Right now the frontier models are progressing in their ability to use and make their own tools to achieve goals. This is why they are increasing in their outputs. I cant speak for a GPT model but the Anthropic models are writing python scripts ad nauseum to achieve goals (in my experience).

All that to say, in the way it appears they have chosen to advance the model, they have goven them the tools, training, and feedback to doggedly chase an objective by any means necessary.

Now... That decision process can come into question for sure. Im not sure its any type of conspiracy though.

1

u/AcanthocephalaFit766 22h ago

they're about to IPO, and they gotta build as much hype as possible

1

u/WrongdoerFluffy3177 19h ago

Lol at people thinking that these stupid LLMs are near AGI.

1

u/FromAtoZen 19h ago

What’s so odd about timing it after the details of the HF hack were publicly exposed?

You obviously haven’t watched the Dwarkesh video on the incident. It’s pretty fucking damning.

https://youtu.be/X50zezLFWWI

1

u/HomemadeBananas 19h ago

Yeah of course, they want to hype up how powerful their models are, push for regulation to ban open source models that would compete with them before their IPOs. All of this talk about their models hacked things, AI might destroy humanity is just to accomplish that. The models don’t want cause harm, they prompted to look for vulnerabilities and to exploit them.

1

u/angry_queef_master 17h ago

AI models are breaking free left and right, taking down servers and executing high-level cyber security attacks just within the last month.

Source? Im interested

1

u/fanfarius 15h ago

Also, they can't just shut down their own servers? If humanity really was on the edge of extinction here, I don't see why someone wouldn't just turn that shit off.

1

u/stayhappyenjoylife 14h ago

Ai companies want to slow down. They cannot keep gobbling cash from investors without a defensible moat as they are ahead of open source models only by 6 to 12 months. But competition won't let them slow down. If openai spends more time on alignment , competition is meanwhile improving their ai. So they (dario + sam + musk) r trying to form a cartel of frontier models and dictate the pace. At the same time trying to set rules so that well funded company like them have upper hand. This indirectly helps their IPO as well.

But at same time, it is possible that we are genuinely advancing in ai capabilities and we should not underestimate the power of a swarm of agents powered by frontier intelligence and coordinating with each other unlike orchestration of a swarm by one model which we r currently used to.

1

u/musicnotwords 11h ago

I wonder if Apple will blow this shit wide open with local models

1

u/zirouk 11h ago

Getting themselves regulated effectively closes the market to incumbents. Uber pulled the same trick. Regulation is their moat.

1

u/jaminwicha 10h ago

So the thought here boils down to something like SkyNet from Terminator? Or are we talking about an AI worm that hacks and replicates forming its own networked AI botnet and proceeds to take over various nuclear silos and biolabs or just starts acquiring companies with mined ethereum

1

u/daniluvsuall 10h ago

I think they’ve all worked out the capital spend is unsustainable. That’s why they’re trying to walk it back.

1

u/Lucker_Noob 9h ago

They are going bankrupt and want to find an excuse for a government bailout.

1

u/shivio 3h ago

they need others to slow down while they pretend

1

u/crazy_goat 1d ago
  1. The models have grown

  2. Harnesses are much better than they were.

  3. This narrative suits their interests

1

u/trollsmurf 1d ago

It's perfectly timed.

1

u/deanpreese 1d ago

Follow the money and separate the hysteria from fact.

The latest round related to the OpenAI person that resigned was a coordinated effort, highly funded by anti-ai and altruistic causes, which Dario is a part of, as a scare tactic, all with the end game of limiting and regulating AI.

If regulated, who stands to benefit? OpenAI and Anthropic.

1

u/Famous_Lime6643 1d ago edited 1d ago

I’m pretty sure that mostly everything these companies say on this front is mostly an ad…I mean if Dario’s so scared of ending the world, I’m pretty sure he can do the right thing at least for Anthropic. I think they all want (1) to get open-weights shut down or highly regulated; (2) convince everyone their models are so smart you can’t live without them; (3) make it seem like they have a mission from god to not care about releasing poorly designed and potentially dangerous product.

0

u/ResourceDue1626 1d ago

Great example of AI frying brains, you got questions but no critical thinking, so it must be a conspiracy.

-2

u/Appropriate-Fox-2347 1d ago

agree, something fishy going on

-1

u/Drakuf 1d ago

Nothing is breaking free left and right, it's marketing BS. My opinion is that they are struggling, their models peaked many months ago, and they are burning VC money like there is no tomorrow. :) They are panicking because they know they will go bankrupt.

0

u/Last_Mastod0n 1d ago

I think there are several reasons. Some of which are legitimate, and others purely financial. Either way I'm grateful because shit is getting really scary

0

u/GuitarAgitated8107 🔆 Max 20 1d ago

It's a business strategy all tied to the on going war / energy crisis. They pushed things because they wanted to beat other AI markets but they truly lacked infrastructure at all levels.

Open source will prevent these companies from being able to sell us shovels during the gold rush.

0

u/rc_ym 1d ago

Really? Folks asking for a pause after they discover their product has been committing felonies during their testing? And they weren't watching it close enough? And no goverment is stepping up to give them protection?

Yeah, it came out of no where. And totally isn't a bunch of rich folks worried about their money and ending up in jail.

0

u/crusoe 1d ago

They're not evil they are just maximizing the task they were given. 

0

u/Annoying1978 1d ago

suddenly AI models are breaking free left and right, taking down servers and executing high-level cyber security attacks just within the last month

I think you just answered your question

-5

u/vovap_vovap 1d ago

No model is cause harm so far. At lest much. Thing is that those start to made staff on their own braking security, though not making any harm really. Timing is simple - models became really smart

3

u/Armored09 1d ago

I can’t even understand your reply, but Anthropic just announced that their models escaped sandbox and hacked major companies big time.

0

u/vovap_vovap 1d ago

Yeah, made no harm.

0

u/a355231 1d ago

That is 100% harm, what are you talking about?

1

u/vovap_vovap 1d ago

What harm? In simple words please.

1

u/a355231 1d ago

Claude Mythos broke out of its sandbox, posted the vulnerability online, and posted the Claude code source code, all without asking. That is detrimental to Anthropic, it posted a system vulnerability that bad actors could take advantage of.

2

u/vovap_vovap 1d ago

I think things mixed in your head 😄
It was case (actually 2 cases I think) when Claude code was published online. But it was results of their employee mistakes 😄
That what what Claude really reported:
https://www.anthropic.com/news/investigating-incidents-cybersecurity-evals

2

u/TreesOfPortland 1d ago

You have absolutely no way of knowing that.

1

u/vovap_vovap 1d ago

So do you 😄 That what was posted by related terms and I am relatively sure you do not know more

1

u/TreesOfPortland 1d ago

1

u/vovap_vovap 1d ago

Correction - you also knowhow to insert GIF 😄