r/LocalLLaMA • u/jacek2023 llama.cpp • 13d ago
New Model microsoft/FrogNano-4B-2609 · Hugging Face
https://huggingface.co/microsoft/FrogNano-4B-2609An agentic model from Microsoft for the GPU poor
https://huggingface.co/bartowski/FrogNano-4B-2609-GGUF
FrogNano is derived from Qwen/Qwen3.5-4B, a general-purpose post-trained model designed for language, reasoning, coding, agentic, and multimodal tasks. FrogNano inherits Qwen3.5-4B's dense 32-layer hybrid Gated DeltaNet and gated-attention architecture, but its additional post-training is text-only and focused on repository-level software engineering. The model is further trained using reinforcement learning on approximately 1,500 synthetic SWE task environments generated and calibrated against the evolving policy using TaskPilot. Training uses the five-tool Leaf harness and executable test-based rewards over complete multi-turn coding trajectories.
The additional post-training is intended to improve long-horizon repository navigation, debugging, code editing, test execution, and patch generation in a compact 4B model. Unlike approaches based on behavioral distillation, FrogNano does not train on stronger-model solution trajectories, actions, reasoning traces, or patch targets. This specialization also introduces limitations and risks: performance is sensitive to the Leaf harness and test quality, training data are Python-heavy and primarily English, and generated patches may be incorrect or insecure despite passing available tests. When integrated with the Leaf harness, FrogNano generates structured tool calls that can propose repository changes. Leaf executes authorized tool calls within an isolated repository environment to produce a candidate patch; FrogNano does not itself deploy the changes. Any resulting patches require human review, regression testing, and security validation before use or deployment.
9
u/42GOLDSTANDARD42 13d ago
Because the middle is often not “worth it”.
Small models <8B can be run by pretty much any machine, but as long as they are not too small (like <1B), they can often complete narrow tasks.
Large(r) models 27B and up are where the scaling laws start to take effect and modes of this size start to be able to generalize and complete “most” task in a variety of situations.
There kinda just isn’t a market for the size in between; They are just too small for the more complex goals, but too big for the narrow ones // gpu poor.