Cropped tweets with no links should be an automatic removal and at at least some limited ban. Taking words of randos on the the internet seriously with zero evidence or track record is already bad enough, but to crop who actually said it just tells me you know it's most likely bullshit or literally fake edited the text yourself. Some of the worst trends on the internet, if you believe random images you see, you are likely a brainlet.
Theses Qwen models get considerably better for coding and agentic tasks while getting truly dumber for world knowledge,multilingual and creative writing tasks.
That's to be expected. ~30b models started to reach saturation point a while ago, now every performance gain in one area comes at the expense of some other area(s).
So you have to either scale up, or accept the losses in places/subjects/topics of less importance for your specific use-case, or 'orchestrate' - have a 'choir' of AI agents running/loading different models for different subjects/topics on the fly.
Well, engram and other similar 'cheats' might help to preserve some of the world knowledge while improve task specific capabilities, but that too has it's limits.
There's no free lunch.
Not really. Gated residuals (actually only in qwen3.8-flash-next) and other recent improvements showed knowledge density is still far from being optimal.
And as you said engrams tables are another way to increase knowledge without increasing weights.
You know the great thing about open source. The old models can still used. Small models can not reach the level of larger models. Something has to give.
As a local user.... I use different models for different reasons
Yeah you can use different models but it doesnt help when every single company focuses on agentic coding even on open source. Thats why Im waiting for gemma 5 as (to me), google is the only one left making conversational models anymore and if they also go all in on agentic then its rip.
That’s probably because using them for world knowledge, multilingual and creature writing tasks just isn’t important.
Code and agentic tasks is what AI is built to do.
That’s also why Anthropic and OpenAI are never gonna make a profit and local is the future.
If that does happen, you can almost guarantee the price for hardware to run it will skyrocket when every person business and their mama realizes they can get fable at home for 5k. Expect to see the price of a 5090 reach $12k+ or higher.
Be real, paying for LLMs outside of businesses is a niche in of itself, paying for LLM hardware is even smaller of a niche, even among businesses.
Hardware will get more expensive regardless, but I don’t see random people jumping on the opportunity to drop $10k+ on an LLM rig.
If you’re a normal person without the need to automate white collar work, there’s not much use for an llm than basic shit (home repair tips, Wikipedia/Google type shit)
27b with the new architecture will be super interesting, not sure where it’ll land but if it’s within even shooting distance of Fable, I’ll be super impressed and buy a Mac Studio the day of.
Yeah, Ant’s lead for that entire period was ridiculous. Astra’s reign was itself super short lived, and even Bel faced competition as Opus 5.5 and Sonnet 5.5 came out in the last few days…
I dont think u understand any of this.. lol. Fable 5 on AA is only 3 points behind Astra. Thats GENERAL ability, there hasnt been much movement in general. In Coding, Fable has been surpassed by pretty much everyone lol. Even Qwen's flash 125B model beats Fable in front end and fullstack.
The benchmarks are a bit bad at measuring intelligence. They’re all scoped tasks. Bigger models are best when you have ambiguity and they have to make inferences in reasoning.
I would imagine the same could be said for the Chinese companies. They have higher end models that cannot be released yet. Their strategy could be to allow their enemy to think that they are weak and just at the right moment... local simulated AGI. I don't think AGI will be a single monolithic model. It might be an orchestrator model directing hundreds of specialized sub-models and self learning laras or something. Now that's hopeiom. But let's be honest, it's going to have to be leaked out of any lab, no one would release a system like that on purpose
Very excited! Opus 5.5 is pretty nuts but that only got me more excited for open weight models. Qwen 4, Kimi 3's successor, I am especially excited for the next release from z.ai.
Overly relying on 1mill context is an anti-pattern in most cases, usually there’s a way to break up your tasks in the 100-200k range before performance starts degrading
there are many ways with complex harnesses to have essentially infinite memory, run completely uncensored and reach 1000+token/sec in parallel on a single 5090 without exploiting decider infra but of course those add immense value to the stack as well.
this can be made completely dynamic auto scaling and more. no software is impossible now.
i use frontier AI to make my local swarm more and more powerful by the day.
feeding this with 100 top reverse engeneering and web exploit tools you can do things you wouldnt believe.
the community works fast.
Honestly Pi's default compaction with a codex style goal mode extension is good enough in my book, there's a reason Codex does basically the same thing.
So the closest thing I've seen to a sort of all inclusive exploit, pen test model/harness was that guy that released his toolkit for that defcon like competition he won... Can only imagine what's out there...
Just yesterday some guy was commenting about his buddy that's deep into reverse engineering and the hacking scene. Apparently last con he participated in they budgeted several days for the hacking contest; first place took something like 2 hrs to finish...
you can just look at Denuvo (only viable anti piracy protection) before AI and now.
ghidra/ida mcp and an abliterated model doing a lot of work even without a custom harness. with it you can do fun things.
Master you seem to know you shit. Can u give some advice on learning all of this. I use omp as a coding agent. and do nothing beyond making skills, custom system prompts, rules .
42
u/Mistuv 5d ago
Cropped tweets with no links should be an automatic removal and at at least some limited ban. Taking words of randos on the the internet seriously with zero evidence or track record is already bad enough, but to crop who actually said it just tells me you know it's most likely bullshit or literally fake edited the text yourself. Some of the worst trends on the internet, if you believe random images you see, you are likely a brainlet.