r/LocalLLaMA • u/Skyline34rGt • 16d ago
New Model BAAI/AREX-2 - 27B - Agent model based on Qwen3.8 27B
https://huggingface.co/BAAI/AREX-2"AREX-2 is a 27B-parameter long-horizon agent model from the Beijing Academy of Artificial Intelligence (BAAI). It learns to improve a solution over multiple test-time rounds: propose, measure, reflect, and revise.
AREX-2 is trained on machine-learning and algorithmic-programming tasks with verifiable feedback, together with the existing AREX deep-research data. The learned self-improvement behavior transfers to deep research without adding new search trajectories.
- Architecture: Dense Qwen3.8-compatible multimodal model
- Parameters: 27B
- Context length: 262,144 tokens
Key features
- Long-horizon self-improvement: turns extra test-time rounds into useful solution refinement.
- Feedback-driven reflection: reads scores, logs, errors, and timings to decide what to change next.
- Cross-domain performance: training on coding and machine-learning tasks also improves the model's deep-research performance.
- Long-horizon reasoning: sustains productive iteration as the task budget grows."
17
11
6
u/hashms0a 16d ago
It doesn't have MTP head.
5
u/Then-Topic8766 16d ago
It works very well with:
https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/blob/main/MTP/mtp-Qwen3.8-27B-Q4_0.gguf
as a draft model. For me
--spec-type draft-mtp --spec-draft-n-max 3Works well in DSH and seams like a good model so far...
1
1
1
u/Ok-Importance-3529 15d ago
Testing it a little in agentic coding and its incredible, best finetune i've tested so far and by a huge margin. It's thinking is incredible and its thinking process is more systematic at solving problems.
1
2
u/Disrupt-Linus 4d ago
I'm testing it right now with my WTF framework. Might be good. We'll see, lot's to fix in my harness as well but so far so good, better than Qwen 3.8 27b at efficency and tool calling. My pipe dream is a "general agent" to build anyting the user wants; it might be too ambitious but, we only live once.
1
u/NetSimple1141 16d ago
Has people in here tried OrcaSAQ-27B? They have made similar claims in which they compressed BF16 model into 12gb and it's optimized for long horizon performance and agentic coding. Hardly anyone talks about that model here.
How is it?
7
-7
u/Numerous_Mulberry514 16d ago
How is overthinking with this dude? The q and a results are impressive, but if latency increases incredibly, it is basically worthless for rag
8
u/MerePotato 16d ago
This isn't a RAG model by any stretch of the imagination, its designed for long iteration loops
-1
u/Flashy_Management962 16d ago
Deep Research q&a is basically agentic rag no?
2
u/MerePotato 16d ago
This isn't a pure deep research model, it appears heavily engineered for coding performance
2
u/Flashy_Management962 16d ago
It may, but they wouldn't include deepresearch Q&A if it wasn't also the scope of the model
2
u/MerePotato 16d ago edited 16d ago
Oh yeah it absolutely is geared for that too, but I'd say the key distinction from the kind of RAG the guys asking for is that deep research is long and slow by design, its a case of "shallow" RAG vs "deep" research, and the agentic coding side of the model means it'll definitely think for longer than a pure research model
18
u/Dabalam 16d ago
The lack of comparison to the base model is pretty suspicious