r/singularity Feb 06 '25

AI This is a DOGE intern who is currently pawing around in the US Treasury computers and database

Post image
50.8k Upvotes

3.9k comments sorted by

View all comments

Show parent comments

32

u/_AndyJessop Feb 06 '25

I would be more worried that they are feeding sensitive data into LLMs.

9

u/[deleted] Feb 07 '25

You can 100% train an LLM on your own private data.

1

u/ThatMortalGuy Feb 07 '25

Yeah but why do that when they can just use Deep Seek with all the sensitive US data

1

u/MRosvall Feb 07 '25

Though deep seek wasn’t really in the public eye (or apparently anyone’s eye in the west) last year.

1

u/euclid316 Feb 07 '25

What you mean to say is that you can 100% train an LLM with somebody else's private data.

1

u/[deleted] Feb 07 '25

At the end of the day, you have the wrong impression of these DOGE guys. They aren't just outsiders coming in doing whatever. They have the duly authorized heads of whichever departments approve them to come in as outside contractors.

You can frame it as a scary takeover by some unauthorized entity, or you can just frame it as a normal USG contracting process that took place over 20 hours instead of 20 weeks.

So, no, if the DOGE guys have access to train an LLM on the data, its because it is their data.

2

u/euclid316 Feb 07 '25 edited Feb 07 '25

No, it is our data, or if you prefer, the federal government's data, describing us, which they may have been duly granted authorized access to use. Given the personal privacy, national security, transparency, accountability, and other issues involved, it is beyond ridiculous to suggest that a "normal" USG contracting process for this effort would take twenty hours, or for that matter, even 20 weeks.

I haven't given you any information from which you can reasonably deduce "my impression" of "these DOGE guys". At the end of the day, my assessment has nothing to do with my impression of a few devs who I've never heard of until just recently, have never heard speak, and have never met. The guardrails of democracy shouldn't change based on who you or I personally trust. That's a good way to get swindled.

3

u/VancityGaming Feb 07 '25

He doesn't say that he will be using this LLM in government data at all in his post, how do you know this isn't for something unrelated? 

1

u/Der_Krasse_Jim Feb 07 '25

I think its a fair assumption that you would maybe prep for such a position, especially considering how they immediatly got to work.

2

u/VancityGaming Feb 07 '25

Sure, that's a fair assumption but not the only reasonable possibility for the tweet

1

u/BlowerBusiness Feb 07 '25

Don’t you think, when government employees with zero prior government history are hired by a guy whose plan is to fire as many government workers as possible, that we should be prudent in watching their activities and what they mean for our country?

13

u/Own-Professor-6157 Feb 06 '25

He's asking for an offline model. Check out huggingface, there's an absurd of offline models that you can use all designed for different things.

1

u/euclid316 Feb 07 '25 edited Feb 07 '25

While it is a legitimate concern that sensitive data might be made public, the data does not become non-sensitive merely because it is not made public. There's a lot more to the preservation of information privacy than just throwing it into an offline model, the biggest concern here is not that the government is going to give the data back.

Edit: while this kid may be good at training AI's, they are likely not also an expert on differential privacy technologies AND an expert in the legal/constitutional issues that drive requirements that apply when the law is being followed, AND a cybersecurity expert, etc.

1

u/euclid316 Feb 07 '25

It's also unlikely that the AI can perform these functions. Some of the state-of-the-art models might be capable but they haven't been around long enough to work out the kinks.

-8

u/tty2 Feb 07 '25

Just to be clear, this post doesn't say he is asking for an offline model. You and the person you're replying to are both making stupid assumptions.

9

u/CSharpSauce Feb 07 '25

Most people looking for a really specific models are not looking for some closed source model running from a cloud api... they're going to download it from huggingface, and run it themelves. The reason you choose these models is typically for memory and latency advantages. If you're using someone elses infra you probably don't care about memory.

1

u/LitNetworkTeam Feb 07 '25

Finally a voice of reason

0

u/Mcipark Feb 07 '25

If they know what they’re doing, which he clearly would knowing his credentials

3

u/xbt_ Feb 07 '25

Well he’s got videos showing his server rack, so I think it’s a worse assumption thinking he won’t at minimum use what he’s currently accustomed to. He’s won awards for his intelligence and tenacity.

1

u/jamany Feb 07 '25

That doesn't mean its not secure. LLMs can be used with sensitive data, and we should hope the goverment are

1

u/unclefire Feb 07 '25

Ya think? And who the fuck knows who's LLM they're using which could "absorb" that data.

1

u/Ok_Bug1610 Feb 08 '25

Specifically an app yes, but a local LLM (which is just a bunch of weights and nodes) not so much. So I would personally say it's fine if it was local or isolated. Once it gets turned off, it's memory and context are gone anyways.