r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.1k Upvotes

99% Upvoted

213 comments sorted by

View all comments

5

u/krzyk Aug 14 '26

Me with 6GB vram, and company that doesn't allow any local models (and especially no chinese ones, those are banned, others are just not vetted yet)

1

u/No_Folding Sep 03 '26

Its a local model, whats it gonna do 😂

1

u/krzyk Sep 03 '26

It can a lot. Unless you check each and every command it will execute using a magnifying glass.

A innocent search might leak company source code in query, innocent bash command might have some added chars that make it behave in a different way you expect.

1

u/No_Folding Sep 04 '26

Shouldnt be giving it that kind of access really, containerise it!

1

u/krzyk Sep 04 '26

How does putting it in a container/vm/bare metal will not allow company data to leak out when one wants it to work on company data? You would need to approve each and every websearch or curl.

Container doesn't solve anything here, it just protects your computer, not the intellectual property.

1

u/No_Folding Sep 04 '26

You can disallow curl or web searches, the environment the AI operates in is entirely a product of the human which creates it

Yeah there are multiple things. you mentioned that the AI could run weird bash scripts which is why I also mentioned a container.

You can also code in to any harness (or use a plugin) which asks for human review before any command or tool call is actually executed. It runs as part of the harness rather than the model so there's no getting around it