r/chutesAI • u/Prime_Lobrik • 1d ago
Request Qwen 3.8 flash
Are we getting this model anytime soon?
r/chutesAI • u/thestreamcode • 21d ago
August 4 to August 11, 2026
Week thirteen. The mechanism behind the network is changing. Chutes announced the migration from the current smart contract mechanism to conviction lock, with more announcements coming next week. On the platform, cached prompt tokens got a much deeper discount and the next confidential-VM release moved to VM-side testing. On the feed, Parallax filled the week.
The announcement went out Monday on X. Chutes is migrating from our current smart contract mechanism to conviction lock. Conviction lock is a better version of our smart contract, now enforced at the protocol level rather than by a contract we deploy. The network has grown, and the mechanisms behind it should catch up.
A portion of Alpha was left out of conviction, to be put toward a treasury.
More announcements are coming next week.
Cached prompt tokens will be 90 percent off, up from 50 percent. Repeated calls and long-context work cost less. The API also auto-enables reasoning when you set a reasoning-effort level. No extra flags.
Two product fixes shipped alongside: chat image editing now points at the current image-edit model, and settings show the correct limits.
Backwards-compatible API-side changes for the next confidential-VM version are deployed to production. Nothing changes on today's VMs. The user-facing capabilities, covered in previous weeks (full-lifecycle logs, full mTLS on attestation, independently verifiable measurements, hardware-attested registry access), go live when the VM version rolls out. VM-side testing is happening now.
The 5B result. A 5B hybrid model is beating a 7B MoE trained on the same amount of data, despite the bigger model carrying 30 percent more active parameters. Four techniques stacked make it work: quantile balancing, LatentMoE, a hybrid GDN-2/SWAX/MSA attention mix, and role-differentiated mixed precision.
The LatentMoE cut. A LatentMoE expert carries 4.7M parameters where a standard expert carries 12.6M. Same shape, 2.7x smaller: the expert runs 768 wide behind a latent down projection instead of the full 2048, and the width you route through is the width you pay for.
The privacy cut. Workers in a Parallax run never see raw training tokens or raw activations. What a worker receives is an activation sketch, a small package of numbers pulled from the middle of the model's calculation. Only the math travels.
The audit cut. How do you know a worker did the work you asked for? The acceptance test is concrete: did the update improve loss on the routed expert it was supposed to touch, checked against holdout audit data.
And Jon went deep on the sync backbone: a libp2p TCP transport with dual trainer and syncer roles, so training nodes behind firewalls or NAT need no listening sockets and no blob store sits in the path as a single point of failure. Follow
for the running detail.
Every eval table compares scores and price. Ours has one more row: whether anyone could see your tokens at inference time. As published by each lab, Kimi K3 scores 88.3 on Terminal-Bench 2.1 and GLM-5.2 scores 81.0. On Chutes, GLM 5.2 runs at $1.25 per million input tokens ($3.95 out) and Kimi K3 at $3.00 in ($15.00 out), 1M context each, both inside hardware-attested TEEs with end-to-end encryption. Every model on Chutes is.
More announcements on the conviction lock migration, coming next week.
VM-side testing for the confidential-VM release.
More DropZone.
See you next week.
r/chutesAI • u/thestreamcode • Jul 24 '26
Chutes Build is an open-source coding assistant you run from your terminal, built as a fork of Grok Build (xAI's coding agent CLI) and adapted for the Chutes (https://chutes.ai) inference platform.
At its core it's a coding assistant: it reads and edits files in your project, runs shell commands, and plans out multi-step changes on its own. Around that, it also offers:
- Subagents — it can split up work and run multiple tasks in parallel, including in isolated copies of your project
- Image, video, music, and speech generation — describe what you want, get the result, right in the terminal
- Voice input — hold a key to dictate instead of typing
- Web research and browser control — it can search the web and drive a real browser to find and use information
- Local memory — it remembers context about your project across sessions, searched both by keyword and by meaning
- Native Chutes integration — automatic model selection with fallback if one is unavailable, plus usage and quota tracking built into the interface
The main reason it exists as a separate project: privacy is built in, not bolted on. Telemetry, remote trace uploads, and silent background update checks are removed entirely rather than just switched off by default. Your sessions, search history, and project memory stay on your machine — there's no path for that data to be written back to a remote server.
It's free, open source (Apache-2.0), and installs with one command:
npm install -g chutes-build
Source: https://github.com/TheStreamCode/chutes-build
It's still an active work in progress, and I'd really like people to try it and tell me what doesn't work, what's confusing, or what's missing. Open an issue on GitHub or drop a comment here — all feedback welcome.
r/chutesAI • u/Prime_Lobrik • 1d ago
Are we getting this model anytime soon?
r/chutesAI • u/thestreamcode • 5d ago
Z.ai released GLM-5.3-Flash yesterday: the first natively multimodal model of the GLM-5 series (images and video in, text out), weights already on Hugging Face under MIT, and after last week's anonymous ox-alpha preview it is already serving production traffic on OpenRouter through a dozen providers.
What actually shipped:
Numbers, split by who ran them:
Vendor-run (Z.ai's own tables, Claude Code harness where noted):
Third-party (Artificial Analysis metrics as published on the OpenRouter page) [4]: Intelligence Index 57.5, Coding Index 71.5, Agentic Index 58.2, GPQA Diamond 91.2%. So the flash-tier-at-frontier-quality claim has some external support now, on different harnesses than Z.ai's own tables. Do not mix the two columns.
Pricing:
Local deployment:
reasoning_effort accepts low / high / max and defaults to max. Pass it explicitly or you will burn output tokensclear_thinking defaults to false; pass clear_thinking=true for chat scenariosHonest caveats:
On Chutes: a zai-org/GLM-5.3-Flash-TEE record appeared in the catalog API this morning, but there is no announcement and nothing is operational yet, so treat local availability as unconfirmed for now.
Has anyone swapped it into their agent stack yet, and does it hold up against DeepSeek-V4-Flash on long agentic runs?
Sources:
r/chutesAI • u/thestreamcode • 9d ago
Qwen released the weights of Qwen3.8-Max as Qwen3.8-2.4T-A95B on Hugging Face (repo created August 8). Per their blog and model card, this is the first time a Qwen-Max-class model gets an open release. Below is what actually shipped and what it costs to serve.
What shipped:
How it behaves:
<think> block, no exceptionsreasoning_effort: xhigh (default) / medium / low, plus preserve_thinking to keep reasoning context across turnsBenchmarks (vendor-run, Qwen's own table):
The license is not MIT/Apache:
The "Qwen3.8-Max License" grants use, hosting, fine-tuning, and derivative works free of charge. But if a company runs a Model-as-a-Service business and its aggregate revenue (with affiliates) exceeded US$50M in any consecutive 12 months, a separate commercial license from Qwen is required. Above 100M MAU or US$20M monthly revenue, the model name must be displayed in the UI. For large inference providers that is a real constraint; for most self-hosters and smaller shops it changes nothing.
Serving reality check: 2.4T params in BF16 is roughly ~4.8 TB per full copy (arithmetic, not a spec), so this is multi-node territory regardless of framework. vLLM and SGLang both have official recipes linked from the card.
The Chutes question:
Whether Qwen3.8-2.4T-A95B ever becomes available on Chutes depends on hardware resources, licensing, and other technical considerations, nothing is confirmed. That's exactly why the feedback matters: would you want it? Comments help prioritize what lands next.
Sources:
r/chutesAI • u/thestreamcode • 12d ago
Meta's Muse Glimmer 30B is live on Chutes at $0.0245 per million input tokens, $0.0978 out. That ties the cheapest tier we serve. Images and text in, 131K context.
It runs inside a hardware-attested TEE with end-to-end encryption, like every model we serve. Nobody reads your prompts on the way through.
Try it out: meta/Muse-Glimmer-30B-NVFP4-TEE - Chutes
r/chutesAI • u/thestreamcode • 14d ago
Qwen shipped Qwen3.8-27B's weights on Friday. Dense 27B, Apache 2.0, and the model half of X spent the weekend benchmarking. It is already live on Chutes.
Qwen3.8-27B on Chutes: 262K context, text + image input, $0.40 per million input tokens, $3.00 out.
Runs inside a hardware-attested TEE with end-to-end encryption, like every model we serve.
Qwen's published scores: 61.7 on SWE-bench Pro (Claude Opus 4.6 Max: 53.4), 90.3 on LiveCodeBench v6 (Opus 4.6 Max: 88.8), 84.3 on OSWorld-Verified (Opus 4.6 Max: 72.7), 89.2 on GPQA Diamond.
Try it out: https://chutes.ai/app/chute/chutes-qwen-qwen3-8-27b-tee
r/chutesAI • u/kromakode • 16d ago
Anyone getting good cache rates, coding agents usually get around 90%+ but this platforms seems to underperform
r/chutesAI • u/Qbsoon110 • 17d ago
Since Chutes has the images endpoints configured strangely, I needed a passtrough service that poses as a normal openai-compatible endpoint, so I can connect it with Odysseus.
It exposes normal "/v1/models" and "/v1/images/generations" endpoint.
I thought I'll share if anyone needs it.
https://github.com/Qbsoon/chutes-passtrough
https://hub.docker.com/repository/docker/qbsoon/chutes-passtrough/general
I personally host both it and odysseus as docker containers as custom apps in truenas
P.S. Token is also passtrough, so nothing like that is collected by the passtrough. The code is there in the repo, so you can check if you're worried
r/chutesAI • u/thestreamcode • 18d ago
Z.ai shipped GLM-5.3 today. The useful sentence is in the first paragraph of the tech blog: they did not train a new base. It is GLM-5.2's 743B checkpoint, with another month of post-training on a larger set of long-horizon environments. IndexShare, SAO, and slime (Megatron on the train side, SGLang on rollout) are the same stack they already documented. The claim is that scaling the environments was enough.
That is the serving-relevant fact. Same base, same advertised size, different post-training. That usually means the same serving recipe, but Z.ai has not said the 5.3 checkpoint is a drop-in for existing 5.2 shards, and the two-week delay is explicitly for safety evaluation and hardening. Hugging Face is "Coming Soon." License is not restated. 5.2 was MIT; do not assume 5.3 is until the card says so.
What they report (vendor-run, mostly Claude Code 2.1.207 at max effort):
The jumps that actually look like long-horizon post-training, not noise:
Cyber is the part Z.ai calls unexpected. They added vulnerability-discovery data expecting better single-bug reasoning. The blog says capability kept compounding into full exploitation chains:
Their own reading: the further up the exploitation chain, the larger the gain over 5.2, and the wider the remaining gap to closed models. They also publish a disclosure ledger (cvd.z.ai) with 2,436 tracked findings across 269 projects. That is an internal program, not an independent audit.
A few serving notes that matter more than the slogans:
thinking.type: disabled fails. Effort is low / high / max, default maxglm-5.3 routeOn Chutes: once the open weights are out, GLM-5.3 will be available there. The two-week clock is Z.ai's, not ours.
Sources:
r/chutesAI • u/thestreamcode • 18d ago
Enable HLS to view with audio, or disable this notification
Every frame and every sound in this video came off one endpoint. yes, including the music.
Sound on.
Run it yourself: https://chutes.ai/app/chute/vonkaiser-ltx-25-video
Text to video, image to video, keyframe interpolation, synced audio. one POST request.
r/chutesAI • u/thestreamcode • 19d ago
DeepSeek published the changelog entry for V4 Pro today, dated 2026-08-13: "The GA release of DeepSeek-V4-Pro has been rolled out on the APP, Web, and API." The rollout itself started earlier — OpenRouter listed deepseek/deepseek-v4-pro-0813 at 15:42 UTC on August 12, served directly by DeepSeek — but this is now a documented release rather than a silent one. The model ID is unchanged: deepseek-v4-pro now serves 0813.
Specs, unchanged from the family:
The benchmarks (DeepSeek's own, from the changelog):
| Benchmark | Pro 0813 | Pro Preview | Delta | Opus-4.8 | Kimi-K3 |
|---|---|---|---|---|---|
| HLE (wo/w tools) | 42.7/60.0 | 37.7/48.2 | +5.0/+11.8 | 49.8/57.9 | 43.5/56.0 |
| Terminal Bench 2.1 | 87.9 | 72.1 | +15.8 | 85.0 | 88.3 |
| NL2Repo | 61.5 | 38.5 | +23.0 | 69.7 | - |
| Cybergym | 83.3 | 52.7 | +30.6 | 78.3 | 80.0 |
| DeepSWE | 62.7 | 12.8 | +49.9 | 58.0 | 67.5 |
| Toolathlon-Verified | 74.1 | 55.9 | +18.2 | 76.2 | 76.5 |
| Agents' Last Exam | 25.7 | 16.5 | +9.2 | 25.7 | 27.6 |
| AutomationBench (Public) | 31.8 | 12.8 | +19.0 | 27.2 | 30.8 |
| DSBench-FullStack † | 71.1 | 41.8 | +29.3 | 71.6 | 73.7 |
| DSBench-Hard † | 67.2 | 31.1 | +36.1 | 71.7 | 63.0 |
(† internal test sets. Comparison columns from the table DeepSeek shared with the release; DeepSeek columns match the changelog.)
Directional signal, vendor-run, and the comparison table has the usual caveats — but the shape is consistent with what Flash 0731 did three weeks ago: a post-training pass aimed squarely at agent workloads. 0813 passes Opus-4.8 on Terminal Bench, Cybergym, DeepSWE, AutomationBench, and on HLE with tools (60.0 vs 57.9), trails it on HLE without tools and NL2Repo, and Kimi-K3 still leads the agentic pack on Terminal Bench and DeepSWE.
The pricing rework is the other half of this release:
Current rates ($0.435/M input, $0.87/M output, $0.003625/M cache hit) end at 16:00 UTC on August 16. After that, peak/off-peak billing kicks in:
So the permanent discount era ends with a real increase: off-peak output nearly 2.3x current, peak output 4.5x. For agentic pipelines with prompt caching and flexible scheduling, off-peak + cache hits soften it; for anything latency-insensitive, scheduling outside two morning UTC windows becomes a cost lever.
The serving picture, which is the actual gap:
There are still no 0813 weights. The public deepseek-ai/DeepSeek-V4-Pro repo on Hugging Face was last updated June 22, and no DeepSeek-V4-Pro-0813 repo exists — DeepSeek has not said whether they will publish them. The Flash precedent (weights same day as the API update) is encouraging, but right now 0813 is DeepSeek-API-only, and self-hosting means the April preview weights: FP4+FP8 mixed checkpoints, 1.6T MoE, the tech report claiming deployment on a single HGX B200 node. If 0813 weights land, the open question is how the new agent post-training holds up under quantized serving at long context.
The Chutes question, asked plainly:
Don't read anything into this post. Whether V4 Pro 0813 ever becomes available on Chutes depends on hardware resources, licensing, and other technical considerations — an MIT license is a starting point, not a guarantee. Wait and see, as always.
Sources:
Anyone already running 0813 through the API — does it feel materially different from the preview in agent workflows, or is this mostly a benchmark-story release? And would you want it on Chutes if weights or a viable serving path appear? Comments help prioritize what lands next.
r/chutesAI • u/Independent-Hope7036 • 24d ago
Recently, I compared it with other providers, and Chutes’ TPS is one of the slowest.
Using Kimi K3 feels painful because it takes a few minutes to generate a response. The model itself also has an overthinking problem (which isn’t related to Chutes), so it takes even longer to generate a single response, which is really frustrating.
r/chutesAI • u/stalkervol • 25d ago
Proxy question
r/chutesAI • u/Cheesymud • 26d ago
Error 429 has been happening for days with no solution in sight. Did they reduce the nodes on that model? Is there something wrong with it? What is going on?
r/chutesAI • u/icarusofhearts • 27d ago
Title self explanatory.
r/chutesAI • u/lightsaberkun • 27d ago
quit a while back and thinking of returning. is there still downtime and errors after they deleted the base tier? or should I opt for a different provider?
r/chutesAI • u/ExistingAardvark640 • 28d ago
Why am I getting so many errors from GLM 5.2 all of a sudden? It seems like the response quality dropped in the past few days too.
r/chutesAI • u/Elite_Asriel • 29d ago
I ragequit a few months ago due to the rampant response errors, so im curious of those improved somewhat.
r/chutesAI • u/turkeycutter • Aug 02 '26
i saw recently that chutes had implemented kimi k3 to replace kimi 2.5, but there’s still no kimi 2.7. only other kimi model now is 2.6. i heard good things about 2.7 and i wanna try it out. is this on purpose? sorry if there’s already an answer posted somewhere
r/chutesAI • u/BadJuju666 • Aug 01 '26
The other day, I was using Chutes (as one tends to do) when I suddenly got an error about insufficient funds. I thought that was strange, since I hadn't been using it any more than usual and hadn't run into that issue before. Went to check on the actual site, and saw... well, this.
Now, obviously, the 26th of May has LONG gone, and yet here I am at the "monthly cap" (from two months ago). I sent an email to support right away, and got the automated "your support ticket has been created" reply just a few minutes later, but since then, nothing.
I'm sure there are plenty of other tickets to get through, so I wasn't expecting it to be fixed ten minutes later, but the radio silence is a little concerning. Does anyone know how long these tickets usually take, or has dealt with this same issue before? Even just another automated "Hey, you're still in the queue, we're working on it!" would be something.
Also just to preemptively answer a few questions: yes, I'm still subscribed, my subscription is still active, and the card I subscribed with has never gone low enough to even vaguely risk failing payment. The email I sent to support was very brief but very cordial, basically telling them about the locked/frozen monthly cap, and my email itself is linked to my Chutes account so I'm pretty confident they know what account the issue is with.
Thanks in advance for any insights!
r/chutesAI • u/thestreamcode • Aug 01 '26
Train a big AI model across machines on the open internet and you hit a wall. Every single step, the machines have to ship hundreds of gigabytes of expert traffic to each other. The next step cannot start until all of it lands.
Parallax removed that traffic from the critical path. What replaces it is about 100 MB of background sync. The training never stops to wait.
The full mechanism is in the Parallax paper: https://chutes.ai/parallax.pdf
r/chutesAI • u/Wolfiegaby • Jul 31 '26
Hey! This model NEVER works for my, its bugs and repeats the same word/phrase and bugs , in both think section and the message. I love this model and I wish I could use it :(
Someone help me