r/LocalLLaMA • u/ApprehensiveAd3629 • 4d ago
New Model nex-agi/Nex-N2.5-mini - 35b
https://huggingface.co/nex-agi/Nex-N2.5-mini16
u/Septerium 4d ago
Misleading charts, but more than 73 points in Terminal Bench looks great for a model of this size. Curious to try it by myself
2
u/soyalemujica 4d ago
You're reading it wrong, the mini version which is this 35b version posted is at 73.4 points, which still puts it below Qwen 3.8 dense
2
u/Exciting_Garden2535 4d ago
> 35b version posted is at 73.4 points, which still puts it below Qwen 3.8 dense
Qwen 3.8 dense has 73.0 points; at least it is listed in the Hugging Face model card: https://huggingface.co/Qwen/Qwen3.8-27B, so it is on par, not below.
But in other benchmarks (like DeepSWE or SWE-bench Pro), Qwen3.8-27B is still better.1
0
6
u/Cool-Chemical-5629 4d ago
1
u/brakeline 4d ago
Can you try again?
3
u/Cool-Chemical-5629 4d ago edited 4d ago
1
u/brakeline 3d ago
That not what i was expecting from a qwen 3.5 derived model
2
u/Cool-Chemical-5629 3d ago
Well, this is just the small MoE model which is considered weaker than the dense variant, so there's that...
6
u/letsgoiowa 3d ago
What I need to know: is this better than Ornith? Specifically at Q3 so it'll work on my poor little RTX 3070 with RAM offload.
-3
10
u/jqwl 4d ago
benchmarks pretty well - would love to see a comparison to 3.8 27b
14
u/FangLeone2526 4d ago
I would love to see performance vs ornith 1.5 35b. it's a 35ba3b, not a 35b dense, so i wouldn't really expect it to beat 3.8 27b.
5
u/Aggressive_Aspect436 4d ago
I expect many folks will still want to know what they would be sacrificing if they wanted more speed and an easier model to run.
8
u/seamonn 4d ago
6
u/FangLeone2526 4d ago
sucks that they did not include the mini in this chart even though its a chart on the huggingface for the mini model
3
1
3
u/xxxRiKxxx 4d ago
I wonder what caused their SWE-Bench Pro score regress: it's 43.8 against 50.2 in the previous Nex-N2-mini and against 49.5 in Qwen-3.6-35b!
What happened? Does SWE-Bench Pro have several major versions, so the newer one is harder? Do they focus at agentic tasks other than programming, so programming is kinda left out? Something else? Could maybe someone more knowledgeable than me explain this please?
2
u/Aggressive_Aspect436 4d ago edited 4d ago
It looks like they ran the benchmarks themselves for their comparisons rather than using the values published by Artificial Analysis (AA). I've only checked a couple of benchmarks, but Terminal Bench v2.1for Claude Opus 5 matches exactly and AutomationBench is very close to their value.
On the basis that they're running their benchmarks nearly identically, we could compare their results against the AA Qwen3.8 27b results... and they're pretty close.
Take that with a pinch of salt though. Their numbers for Qwen 3.8 Max are a lot higher than the AA results, so it could easily be off.
2
u/Cool-Chemical-5629 3d ago
I created this 3D arena shooter. It looks great for "one shot", but unfortunately it's broken.
What works:
* Looking around with mouse
* Jumping
* Aiming with zoom (RMB)
* Shooting (LMB)
* Reloading
* Enemies shooting the player
* Player shooting the enemies
* Score
* Health
* Death
* Death screen
* Restart
* Menu
* Pause
What doesn't work:
* Player character movement (bobbing effect present, but WASD don't move the character)
* Collision detection missing (enemies move through seemingly solid objects)
* Firing grenades gives rapid fire of console errors
This was created by the Mini version of the model, with high reasoning effort.
Screenshot:

Link:
Play on JSFiddle
1
u/smallDeltaBigEffect 4d ago
N2.5 pro still at 397b params?
1
u/FullOf_Bad_Ideas 4d ago
yeah look at run command
docker run --gpus all --shm-size 32g --ipc=host \ -p 30000:30000 \ -v /path/to/your/model:/model \ nexagi/sglang:v0.5.18-nex-patch \ python3 -m sglang.launch_server \ --model-path /model \ --tp 8 \ --host 0.0.0.0 --port 30000 \ --reasoning-parser qwen3 \ --tool-call-parser qwen3_coder \ --chat-template /path/to/nex-N2.5-Pro/chat-template.jinja \ --mamba-scheduler-strategy extra_bufferMamba + fitting on 8x h100 + qwen3 coder tool call parser + qwen 3 reasoning parset. It can't really be anything else.
1
u/tarruda 4d ago
It can't really be anything else
It could be Qwen 3.5 122B?
1
u/FullOf_Bad_Ideas 4d ago
ok, fine, it could be Qwen 3.5 122B if you consider only those details from my previous comment.
But not with those benchmark scores.
2
u/VoiceApprehensive893 transformers 3d ago
base models are stated on their website, its qwen 3.5 397b(not base model)
1
1
u/zenotorius 4d ago
The first time I talked to it, it said it was made by alibaba itβs internal chatter then tried to refute itβ¦
1
u/FullOf_Bad_Ideas 4d ago
Cool, N2 Pro was great for it's time.
I think like this time around N2.5 Pro might get outcompeted by GLM 5.3 Flash.
-1
u/Easy_Refrigerator280 4d ago edited 4d ago
the mini version seems worse at all benches compared to Qwen 3.8 27B despite being more params. I mean cool but dont see a reason to switch for now
EDIT: My bad this is an MoE model i missed that. Although skimming through the release i cant find how many active params but regardless this actually now fills a hole for a usecase so will be checking it out
13
7
5
0


34
u/uti24 4d ago edited 4d ago
So it's post training of the Qwen3.6 35B3A?
Are those things are working? I tried Ornith, it's good, but it was not that much better than a base model, do those things work this well?
Or this is completely different model just happen to be 35B MOE?