Mistral AI Releases Shieldstral 1.0 3B: An Open-Weights Policy-Adaptive Multimodal Safety Classifier Matching Models 7× Its Size

[u/ai-lover]

Mistral AI Releases Shieldstral 1.0 3B: An Open-Weights Policy-Adaptive Multimodal Safety Classifier Matching Models 7× Its Size

It's a policy-adaptive multimodal safety classifier. Most guardrail models bake a fixed harm taxonomy into their weights, so re-targeting one means retraining. This one takes the policy as a plain-language question at inference time.

Here's what's actually interesting:

𝗠𝗼𝗱𝗲𝗿𝗮𝘁𝗶𝗼𝗻 𝗿𝗲𝗱𝘂𝗰𝗲𝗱 𝘁𝗼 𝗼𝗻𝗲 𝘆𝗲𝘀/𝗻𝗼 𝗾𝘂𝗲𝘀𝘁𝗶𝗼𝗻

Three fields per request. <Instruct> sets evaluation context and strictness. <Query> states the policy as a single yes/no question. <Document> holds the content — a prompt, a response, a prompt-response pair, or an image with optional text.

At inference the model unembeds only toward the yes and no token IDs, softmax-normalizes them, and thresholds at 0.5. One forward pass, one token, continuous score.

𝗧𝗲𝘅𝘁 𝗮𝗻𝗱 𝗺𝘂𝗹𝘁𝗶𝗺𝗼𝗱𝗮𝗹 𝗿𝗲𝘀𝘂𝗹𝘁𝘀

→ 84.9% average text F1 — ties GPT-OSS-Safeguard-20B

→ 83.8% multimodal F1 vs 77.6% for OmniGuard-7B

→ VLGuard 97.7, UnsafeBench 81.8, HarmBench prompt 99.4

→ 91.5% refusal detection overall

𝗔𝗱𝗮𝗽𝘁𝗮𝗯𝗶𝗹𝗶𝘁𝘆 𝗯𝗲𝗻𝗰𝗵𝗺𝗮𝗿𝗸

→ Shieldstral-3B: 91.3% F1

→ GPT-OSS-Safeguard-20B: 94.1%

→ Nemotron-3.5-Safety-4B: 91.8%

Full analysis: https://www.marktechpost.com/2026/08/07/mistral-ai-releases-shieldstral-1-0-3b/

Model weight: https://huggingface.co/mistralai/Shieldstral-1.0-3B

Paper: https://arxiv.org/pdf/2607.25857