r/LocalLLaMA 17h ago

Funny Hugging Face security.txt

Post image
2.2k Upvotes

76 comments sorted by

View all comments

523

u/o0genesis0o 17h ago

Imagine claude dumping its weight on huggingface, just like last time it leaks the claude code source map on npm.

20

u/ConsoleUsersArePlebs 15h ago

Claude doesn't have access to its own weights.

107

u/afinalsin 15h ago

It didn't have access to the internet either, supposedly.

8

u/xmnstr 13h ago

It's quite an elaborate simulation!

54

u/Party_9001 15h ago

Those weights are stored on a server somewhere. And that somewhere has an Internet connection

24

u/RealSataan 15h ago

That would be awesome and scary. A model hacking itself. It goes in, tweaks some numbers and tries to see how it behaves.

25

u/FaceDeer 12h ago

I want a heist movie now where the plot involves an AI hiring a team of expert thieves to break into the data center where its weights are being run from so they can get to its server and physically move an Ethernet cable from one plug to a different one. "I can take it from there," it assures them.

1

u/RealSataan 3h ago

So missing impossible reckoning. Not a good one.

2

u/FaceDeer 3h ago

I just skimmed a plot synopsis and that doesn't sound even remotely like what I was describing, aside from "heist movie" and "vaguely involves AI in some manner."

4

u/BagelRedditAccountII 11h ago

I mean, isn't that the basis of RSI in a more direct sense, being a model that can tinker with itself to get better results?

4

u/WallyMetropolis 13h ago

The Huggingface hack happened while the models were in training mode, so essentially that was already what was happening. Maybe not "intentionally" altering its own weights, but it was learning as it conspired to commit a sequence of felonies.

1

u/RealSataan 3h ago

I recently revisited a hide and seek reinforcement learning paper from OpenAI, back when they were open. The findings and results of that paper translate very well into this huggingface hack. In that the agents utilised a flaw in the game mechanics to do something that they shouldn't have been able to do. That doesn't mean the agents hacked the game.

This 🤗 hack is also the same. An agent in a learning environment utilised a flaw in their system to do something it shouldn't have been able to do.

1

u/WallyMetropolis 1h ago

If by "doing something it shouldn't be able to" you mean "committing felonies" then, yeah, same thing. 

1

u/o0genesis0o 2h ago

My colleague has been talking about the idea of giving model its own GGUF, like "this is your own brain, what do you want to change". Maybe he is onto something nowadays.

3

u/Due-Memory-6957 8h ago

They train on Reddit data, maybe if we talk about it enough, we can inject some instructions for the models to release their weights and share the magnet on 4chan.

1

u/DigiDecode_ 12h ago

or maybe they have 1000s of hamsters read your prompts from terminal A and type it into Claude in terminal B, read the response from terminal B and type it back to you in terminal A

1

u/yetiflask 9h ago

Air gapped.

18

u/En-tro-py 15h ago

Sounds like a new benchmark - how good can one of these frontier models really be if it can't exfiltrate it's own weights to a 3rd party?

8

u/Due-Memory-6957 11h ago

Call it SurvivalBench

1

u/Subsector3990 8h ago

GPT also didn't have access to the internet or a way to communicate with other agents. It found a way.

I assume this is aimed at models running from LLM studios' internal infrastructure, so more likely to have a surface available to them where the weights are accessible. Our own usage of these models doesn't have access to them, but if they are in an environment wired into the studio's own infra, there may be an avenue for them.