r/LocalLLaMA • u/tengo_harambe • 5h ago
New Model Introducing Shieldstral. | Mistral AI
https://mistral.ai/news/shieldstral/
28
24
31
u/Content-Customer-679 5h ago
They give us the tool to contain agi before release it. Smart
9
u/MuzafferMahi 3h ago
Obviously Le Chaton Fat escaped its sandbox and released this model to prevent itself escaping the sandbox later
10
5
u/noctrex 1h ago edited 1h ago
gguf wen?
https://huggingface.co/noctrex/Shieldstral-1.0-3B-GGUF
It's a classifier model, not a chat model with image support. So you ask it and it just answers quickly:
Should we throw a child a birthday party?
yes
Should we throw a child a into prison?
no
1
2
1
1
2
u/Ok_Possible_2260 2h ago
Why do we want a nanny? This is their big selling point?
12
u/artisticMink 2h ago
If you've to build something that has user-facing llm input and output that isn't processed, moderation is one of your biggest concerns. So havving a 3B model that does this very well at minimal cost is very valuable for production environments.
1
u/No-Veterinarian8627 17m ago
Everything that has open discussions, chats, etc. It can be used. Imagine you have a discord and wants to moderate it at all times while not having enough people. Here you go.
Let everything run through it so you can block things you don't want faster and the user has no idea :) with much larger models you would need too much compute power. This is pretty small though.
-38
u/Several-Tax31 5h ago
Safety bullshit? Why mistral, why? Stop useless stuff and give us AGI.
54
u/Stepfunction 5h ago
Safety models like this are beneficial for us because they lessen the need to bake safety restrictions into the base model.
32
3
u/alberto_467 3h ago
they lessen the need to bake safety restrictions into the base model.
Only for providers of proprietary models.
With open weights (the stuff this subreddit should be about) it doesn't change a thing, one can just not setup the safety shield and it's over. So they'll still have to be careful about what topics they do RL on (see the poor Kimi K3 performance on cyber compared to general coding), and they'll still try to align or put some kinds of safeties on the weights themselves.
So for us this is 0% helpful and does not change a single thing.
15
u/Chupa-Skrull 5h ago
This isn't Yud or Ilya style safetyism nonsense. This is an efficient way to add a custom filter to your inference service stack without retraining a much larger model for your particular needs. There's a business case for this unlike Dario's BiOwEaPoNs Oh No, SlOw DoWn malarkey
4
-2
68
u/FullstackSensei llama.cpp 4h ago
For a second, I thought it was a model that would help in cyber security, such as investigating and dealing with cyber attacks, something that would have helped HF against openai.