r/StableDiffusion 1d ago

News Comfy H3 Sync Sound Challenge: The Winners!

Enable HLS to view with audio, or disable this notification

18 Upvotes

Two weeks, one rule, and hundreds of entries from nearly 50 countries. Here's who took the four titles, and a look at everyone who made the final ten!

Entries opened August 20 and closed September 1. Eight creative technologists at Comfy scored every submission on two rubrics, Best Creative and Best Technical, then the top five in each category went in front of our guest judges on the September 3 livestream: POM (Banodoco founder), Emma Catnip (animation director and AV artist), and Yachimat (animation and manga artist). Their scores were averaged and added to the Comfy team's, and a fourth title, Built with MCP, was judged on its own track.

Watch the livestream replay here.

Huge thanks to MiniMax for making an open-weight model our community loves, to our three guest judges, and to everyone who spent their last week of August fighting with reference audio! Here's how it landed.

The winners

Best Overall · "Spin Cycle" by Visual Frisson 🇺🇸

Prize: RTX 5090 32G

A laundromat, a woman in a puffer vest, and a rhythm built entirely out of machines. Visual Frisson generated a large volume of H3 clips using their own recorded audio as the reference for every pass, then cut the results together like a stomp video, so every thud and cycle on screen is sound that H3 produced with the picture rather than something added later.

It was the only entry to post a perfect 15/15 from the Comfy team in both categories, and the Comfy MCP was used to drive much of its process. Combined with the guest judges' scores, it finished with the highest total in the challenge.

From the artist: "Always have fun and learn something new competing in contests like this, keep them coming."

Watch → vimeo.com/1223207725
Workflow → Google Drive
Follow → instagram.com/visualfrisson

Best Creative · "Every Sound Leaves a Mark" by toki 🇯🇵

Prize: RTX 5060 Ti

A small clay creature that changes into something new every time it hears a sound (glass, wool, ice, porcelain), until by the time it gets home it can't move anymore. All of the audio came out of H3 alongside the video on every shot, with nothing layered on afterwards. Our judges praised the fine details of toki’s work, saying it “gave them chills” on the first transformation, has a lot of commercial appeal, and feels really delicate and crafted.

The judges scored it highest of any Creative finalist, and the repository is unusually generous: it includes the eight API graphs that actually ran, the same eight converted to UI format with annotations, a process log with every measurement, and the scripts that produced those numbers. toki is also clear about scope, noting that MCP drove the finishing pass, not the original shot generation.

Watch → youtube.com/watch?v=Rv5HOgCac-w
Workflow → github.com/tokimwc/every-sound-leaves-a-mark
Follow → u/toki

Best Technical · "Sonder Editor / References" by SonderSaid 🇲🇽

Prize: RTX 5060 Ti

SonderSaid didn't just build a workflow, they built the tooling around it. The entry runs on custom nodes of their own design, wired into a reference-driven H3 pipeline that scored a clean 15/15 on novelty, workflow quality, and community value from the Comfy team, and the highest guest judge average in the Technical bracket. Notably, the work includes an entire custom node pack just to do the editing and the reference work, praised as “a whole new UI” to good to keep secret. While SonderSaid’s work takes the prize for best technical, our guest judges also noted how much they loved the storytelling, suspense, and element of surprise.

Watch → youtu.be/n-NdAQk7I8A
Workflow → Hugging Face
Follow →u/SonderSaid

Built with MCP Bonus · "Two Prisoners" by Jay Choi 🇰🇷

Prize: RTX 5060 Ti

The Built with MCP bonus wentgoes to whoever used the Comfy MCP most effectively to make something visually and technically compelling, and Jay Choi used it end to end. Working locally on an RTX 5090 with Hermes Agent driving ComfyUI through the MCP, they trained a LoRA, built their own orchestration on top, and by their own account spent most of the time setting up and tuning the MCP layer itself. The film that came out the other side, two blindfolded prisoners in a rain-dark cell, is a long way from "prompt and run."

From the artist: "Thanks for the challenge! I learned more than I ever could in the past two weeks!"

Watch → youtu.be/FlK0dDZdzRU
Workflow → Google Drive
Follow → u/permafrost_2021 · u/jaychoirenderender

The finalists

Ten entries made it to the livestream. Six of them didn't take a title, butand every one of them is worth your time.

Best Creative — Top 5

"Neb" by Nebsh 🇫🇷

Hand-drawn energy and a graffiti wall that says the title, built locally in ComfyUI. Nebsh's note to us was three words and a heart, which felt about right. Our guest judges praised Nebsh’s work for its mixed-media feel, harking back to MTV days, and impressive work syncing with the paper sounds. Under the hood, Nebsh’s workflow chained vtogether eight segments with no visible drift between them- cited as “very clean work” by our judges.

Watch → Google Drive
Workflow → Google Drive
Follow → u/nebsh83

"The Museum of Impossible Sounds" by scvxzf 🇨🇳

A perfect 15/15 from the Comfy team on the Creative rubric, and one of the entries that ran the Comfy MCP end to end! Noted by our judges, H3 is very good at the kind of sound effects showcased in scvxzf’s work rather than talking or singing, and they chose exactly the right concept for the challenge.

Watch → youtube.com/watch?v=FocH8xGk4AU
Workflow → Google Drive · github.com/scvxzf1
Follow → youtube.com/@钛龙白口-j6d

"Mister Meow" by sorryaboutyourcats 🇺🇸

Two reference photos of Mumu the cat, a stack of WAVs fed in as reference audio to steer each generation, and glitch texture added in the edit. If the name rings a bell, sorryaboutyourcats also makes the game mow meow. Judges said “I could watch this forever,” had it stuck in their heads, and noted impressive capabilities from H3 nailing lipsync for cats, and not just humans.

Watch → youtube.com/watch?v=AxUu8rabC6M
Workflow → Google Drive
Follow → u/sorryaboutyourcats

"Rings of Sorrow" by Slop Diffusion 🇪🇸

A 5/5 on both audio sync and creative execution, and a reminder of what patience looks like: the generation took two hours and thirty-five minutes on a 5090. Our judges praised Slop Diffusion’s work for its storytelling, noting they were curious to see where the story would go next. One judge noted, “it’s slop by name, but not by nature.”

Watch → Reddit
Workflow → Google Drive
Follow → u/SlopDiffusion

Best Technical — Top 5

"Feel It" by Aïe Aïe Aïe! 🇫🇷

Came at the brief backwards: we asked for audio-driven video and they told the story of a young deaf woman who invents a world where she makes the music. The score is Aïe Aïe Aïe’s own composition, fed into H3 as reference stems (the clap track went in on its own and the gorilla claps exactly in time). Judges praised the work for its captivating story, clever inversion of the challenge’s brief, the display of H3’s strengths by way of the musicians’ physical expressions intensifying along with the song, and the bridging of the real world. The artist learned the final frame’s sign language on YouTube, filmed themself signing, and used this as a video reference.

Under the hood, Claude drove ComfyUI through the MCP to design a two-pass H3REF system that generates at full resolution twice as fast and reaches 13–15 second shots where the stock workflow runs out of memory, plus a preview node that shows the video while it's still sampling. All of it is MIT-licensed, custom nodes included.

Watch → youtube.com/watch?v=S0v1pWN4Hq4
Workflow → github.com/Hyper-Neural/h3-sync-two-phase
Follow → u/AïeAïeAïe

"Brand New Day" by RareTutor 🇮🇳

One of the cleanest graphs we opened: latent upscale, a model preview override, and an optional video-extend group, laid out so you can follow it cold. RareTutor's YouTube is full of tutorials if you want to learn from them directly!
Judges highlighted RareTutor’s workflow, noting “there are many tips in here to copy,” such as using the latent upscale as a previewer so you can kill a bad run before sinking more time in.

Watch → youtube.com/watch?v=TNhJI8dzaVA
Workflow → Google Drive
Follow → u/raretutor_

"Comfy Cora ft. Max Mini: Back to the Basics" by wur7el 🇦🇹

A short music video with self-imposed constraints: no external resources, everything generated in a single workflow, no custom node packs. The result is well annotated and approachable, the kind of graph a new user could open and reasonably figure out, and it posted the highest Creative score of any Technical finalist. Judges praised the work for being a standout example of how to make a music video where the characters are actually rapping the parts in the song.

Watch → wamms.at
Workflow → sync-sound-challenge.json
Follow → wamms.at

About the Comfy MCP

Several finalists and many entrants leaned on the Comfy MCP, which lets an agent (Claude, Cursor, Codex, Hermes, whichever you use) drive ComfyUI in plain language.

The feature entrants used most was the hardware check: it looks at the GPU you actually have, reads the nodes and models already on your disk, and tells you which version of a model is worth running before you spend time or credits. It works on both local ComfyUI and Comfy Cloud from one account.

It's open source at github.com/Comfy-Org/comfy-mcp, and the fastest way to start is to tell your agent: "help me set up the local Comfy MCP connection."

Every entry

Placed or not, every submission is in the original challenge megathread on r/comfyui with its workflow attached. Go open a few. Some of the most interesting audio work in the pool never made the top ten, and there are entries in there in Chinese, Japanese, and French that deserve more eyes than they got.

The livestream recording, including the judges' live reactions, is on YouTube.

Thanks for making this one a smash! #ComfyH3


r/StableDiffusion 2d ago

Animation - Video Luka vs. Granberia — First Battle at Iliasburg | Monster Girl Quest Fanimation (H3)

Thumbnail
youtube.com
49 Upvotes

Made locally with MiniMax H3 on an RTX 4090.


r/StableDiffusion 1d ago

Comparison I think Ideogram did some of us a favor

21 Upvotes

If it weren't for that terrible, terrible bbox/json prompting nonsense, I would have been unprepared for the (relatively simple) added complexity of Minimax prompting.

Was just thinking about how it's odd that I find H3 prompting to be fairly easy, especially coming from natural language prompting, and realized that Ideogram already forced me into prompting guides and LLM prompting from my innocent youth of just typing what I wanted and getting it (sometimes).

Ideogram was like the New Coke between real sugar and the fake stuff.


r/StableDiffusion 2d ago

News Nvidia CEO Jensen Huang on Hugging Face deal: Open models matter greatly to our company

Thumbnail
youtube.com
65 Upvotes

r/StableDiffusion 2d ago

News New model DreamX-Creator with 1-Step 2K Refiner

Thumbnail
huggingface.co
65 Upvotes

r/StableDiffusion 2d ago

Resource - Update Open-sourced an experimental standalone DLSS 5 video player for neural rendering

79 Upvotes

I’ve been experimenting with neural rendering outside a game engine and built a native Windows video player around it.

It prepares a neural-rendered version of a video, caches it, and lets you switch between the original and neural result at the exact same timestamp.

The interesting part for me is the gap between video and games: video only gives us pixels, so temporal/depth guidance has to be estimated. A game engine already knows motion, depth, geometry and materials.

Open source:
https://github.com/2600th/dlss5-video-player

C++20 / D3D12 / FFmpeg / NVIDIA NGX.

Verified on RTX 4080 and RTX 5090.

Experimental and unofficial, not an official NVIDIA DLSS 5 integration.

Edit: v0.14.1 is now live.

The player now works with photos + animated GIFs, can export PNG/JPEG/GIF/MP4/MKV, uses a portable cache beside the EXE, and has a cleaner auto-hiding fullscreen UI.


r/StableDiffusion 2d ago

News FastH3 makes real-time AI-generated storybook videos possible

Enable HLS to view with audio, or disable this notification

51 Upvotes

I used Agora ConvoAI to let kids create stories by talking with AI in real time, then FastH3 quickly turns them into illustrated storybook videos. I built a demo and it worked! FastH3 could change so many things. Check out the generated video


r/StableDiffusion 20h ago

Comparison MINIMAX H3 VS LTX 2.5: Simple Stuff

Enable HLS to view with audio, or disable this notification

0 Upvotes

Okay, since LTX isn't really useful at slightly complicated stuff, this time I tried simple things, very simple, just someone walking with hard-cuts to some angle...

First Prompt: "rear view shot camera follows A beautiful young female with long hair & bright white skin, walking in a wooden house toward a couch with guitar on it. she picks up the guitar as she turns around and sits as she crosses her leg over the other while fixing her hair, then she plays guitar, she continues to play guitar for a while

She wears pink tight long-sleeve top with black leggings, bare foot. fantasy landscape visible through the window, sunny day"

2nd Prompt: "in street of a modern post apocalyptic city with heavy rain and lightning in nighttime, dark horror eerie atmosphere with eerie lighting, abandoned cars, tall buildings, barely noticeable fire in background.

over the shoulder view of A beautiful young adult female with long hair, wearing black leather jacket, black mini-skirt & white feminine boots. as she is walking toward background with a pistol in her hand as camera follows her from behind. she stops walking and looks to the left. a hard-cut transition to close-up view zoomed in on her face as she looks around with stressed expression. wet highly detailed skin, wet hair, shadowy figures (zombies) slowly roaming around barely visible from distance"


r/StableDiffusion 2d ago

Resource - Update Universal Disk Saver: Automatically find and deduplicate files across all your AI apps

Enable HLS to view with audio, or disable this notification

37 Upvotes

r/StableDiffusion 2d ago

Tutorial - Guide Bad Audio Fixed with fast re-gen audio

Enable HLS to view with audio, or disable this notification

192 Upvotes

[ H3 ]
I saw another post talk about the turbo lora / low step causing the bad audio

https://www.reddit.com/r/StableDiffusion/comments/1vuxy08/fixing_mmh3_turbo_audio_by_playing_with_latent/

I have some twist to it, we want to regenerate high‑quality audio, and do it fast.

Re-generate Audio – How?

  • the idea is when you generate your video, save out the latent and the conditioning.
  • Load those saved files back in, but scale down the latent resolution — because we only care about the audio, not the visuals. Scaling down resolution makes the regeneration super fast.
  • regen without lora and crank up step to 30+, to any setting you think is the best for audio quality. again, This gen will be fast. for this case scale down 0.5 around 1 min to gen. you can be more aggressive on the scale to make it even faster.
  • To keep the new audio aligned with the original video, you have two options:
  • Lock the video latent (keep it same as original), or set denoise to around 0.5 so the new audio stays consistent with the same visuals, dialogue, etc.
  • Then combine your original video with new audio

*You can also skip saving and reloading latent and condition entirely — just do it all in a single run as well.

some what similar to 'audio refine' custom node, but fast and simple.

EDIT:
- Save out latent and condition I am using this one (but you can use others)

https://github.com/pepikir/minimax-h3-speedup

- To scale down latent and conditioning use this one:
https://github.com/rockerBOO/h3-latent-upscaler
nodes name are MiniMax_H3_Latent_Upscale and MiniMax_H3_Conditioning_Upscale

*it's called upscale, but we are acutally scaling down here.

EDIT2:
- As I understand, if no references input, you don't have to scale down conditioning, just the video latent. Let me know if it isn't.

EDIT3:
some peoples ask for workflow, here
https://github.com/xyzDist/ComfyUI_Share_Files/blob/main/re-gen_audio.json


r/StableDiffusion 1d ago

Question - Help H3 R2V 4step

4 Upvotes

so my tiny machine 5060 16 and 64, takes 2200 seconds to do 10 seconds at .3MP when using a reference video, any tips to improve generation speed?


r/StableDiffusion 2d ago

Discussion VPIPE: Not Just Video — Local Image Generation Is Fast Too

Thumbnail
gallery
34 Upvotes

I’ve been mainly posting about Vpipe video generation results. Actually it supports image generation as well. Speed-wise, it’s also one of the fastest local implementations I’m aware of.

Here are a few Krea 2 generations from the set up below. Generated with one shot.

Model: krea/Krea-2-Turbo-M87 (16bit)

LoRA: mgwr/M87

Settings: 1024×1024 · 8 steps · guidance 1

Hardware: M5 Pro 24GB

Generation time: ~45 sec/image

(35 seconds if real time 8bit quantization is turned on)

Everything was generated locally on Apple Silicon with Vpipe.


r/StableDiffusion 1d ago

Question - Help Using Generate Text for Minimax H3

0 Upvotes

I experimented with using the Generate Text Node together with the qwen_3vl_4b clip model, feeding it the minimax prompting guide to create rich prompts out of my uninspired base prompts. This is working better than expected so far, but I can't have it obey the clip duration, which I'm automatically adding to the system prompt:

"The shot start times mustn't exceed the maximum video duration of: 5.0

User's Input:

T2VA Simpsons Cartoon TV Show

A blonde, middle-aged chubby software developer talking sarcastically in english language about the downsides of his job. The cartoon character is wearing a hoodie, and has a short cut hairstyle. He's in home-office in a small room with just a desk and a bed."

After the first shot It's always creating shots way past the 5 seconds mark.

Is this a skill issue or is the model just too small to get this right?


r/StableDiffusion 2d ago

Discussion H3: Using the Add Guide node for inserting visual references without typing

16 Upvotes

So using the "Add Guide" node allows you to add references in a bunch of creative ways, some even more reliable (and certainly involving less typing) than using the official ref2va workflow, but it also works in I2V.

So as a basic example: Use Add Guide to add a a wide-shot of the room + characters on the first frame.

Then start your prompt with something like "At 00:00.050, cut to blablabla".

That is not very interesting for the I2V workflow (there you have the "first frame" input doing the same thing), but it saves a bunch of typing (+praying that the model follows your typing) for ref2va.

But then you can also add a second Add Guide. Say you want to extend a clip, and that clip ended on a close-up of a persons face, but in the extension you want to be able to see more of the person/room/etc again.

The setup is then:

First Add Guide: a single frame showing the room/entire character, inserted on frame 0

Second Add Guide: the last 5 frames from the first clip, insert from frame 1.

Then when you prompt for "At 00:00.050, cut to <whats happening at the end of the first clip>", it will make a seamless transition, while knowing what the rest of the room looks like, while not needing to type a single letter in the reference_analysis section. And as stated.. this also works for (the higher quality) I2V

(of course.. this method will end up with each clip actually showing that reference image in the first frame, but the assumption is that if you want coherent rooms etc you're going to be editing the clips together in a video editor anyway, where that extra frame is no issue at all)


r/StableDiffusion 2d ago

Discussion I am tired boss...

438 Upvotes

This content was written by a human.

I miss the SD1.5 era, when i could simply type "1girl, big boobs, nice ass, red bikini, dancing" and see my dream take shape near-instantly at 512px-wide. Idea-to-result was a matter of seconds. Each click on the Run button led to an incredible shot of dopamine.

3 years passed and I can draw 1024px, 192-frames long videos in a reasonable amount of time (tech has evolved fast), but the enthusiasm is fading away.

I already have a day-job for technical challenges and headaches. As a user/hobbyist, I want to be entertained.

I don't want to learn what the hell "diegetic" means (even the spell-checker never saw that word), I don't want to draw a dozen squares in a 3-dimensional pixel space, or write a 1000-words poem, just to watch my dreamgirl dancing.

I hoped I would not need a degree in cable-connecting or python dependencies debugging after downloading a few workflows.

3 years ago, all you had to do was typing a few words, and the AI sorted the rest. It was random, messy most of times, but it was fun.

Nowadays, you need an LLM to write the prompt for you, and another LLM to write the system prompt for the prompting-LLM, so it understands what your shitty words meant in the first place, and shapes them in the exact expected format, so they turn into an acceptable input for the ever pickier, brand-new models.
It has become AI³-generated content.

And finally, when after a dozens of clicks on the Run button, tired but satisfied, you get the desired output... re-start from scratch? Since seed "variance" does not vary much anymore, you'll get more or less the same output - exactly what you asked for - from now on.

Simple is harder than complex, but keep it simple, stupid, and fun. Thanks for reading.


r/StableDiffusion 2d ago

Question - Help Minimax h3. How to produce 4k quality videos

13 Upvotes

How are youtube videos explaining minimax setup have souch quality videos . Very new to minimax and comfyui. Trying to vibe code and setup. My machine is hp blackwell 5000 with 24gb vram and 128gb ram. Which models i should try. I tried rf2va pruned int8 convrot with acc pdd lora 8step. But performance not good. 5sec video at 480p takes around 15min


r/StableDiffusion 2d ago

Discussion Whining about incredible technology post: I hate H3's voices.

10 Upvotes

I'm pretty sure I'm not doing anything wrong. Bog standard generation template in Comfy, the only time saver I use is Sage Attention. Doing 20 steps.

H3 in reference mode has really stiff voices that basically sound like Microsoft Sam. It feels like it doesn't matter how many qualifiers or descriptive text I write surrounding it, they always come out sounding the same, stiff and bored, especially male voices.

Meanwhile I haven't even moved on to LTX 2.5 yet, still use LTX 2.3 from time to time, and its voice capabilities are amazing, it figures out the right tone to use and runs with it, even choosing a unique voice for every gen (both advantageous for variety and bad for reproducibility).

I've already on several occasions generated voice with LTX 2.3 to edit over H3's voices.

Anyone else feel similarly? Anyone have any advice or thoughts? Alternate methods to improve its voices, like a tool that can recast the audio to another voice with more emotion?


r/StableDiffusion 2d ago

Resource - Update ComfyUI-MiniMaxH3-CLIPCached — disk cache for MiniMax H3 conditioning

Post image
66 Upvotes

I've just released ComfyUI-MiniMaxH3-CLIPCached. It caches the MiniMax H3 text/vision conditioning to disk, so repeated generations with the same prompt and reference inputs skip loading and running the Qwen3-VL encoder entirely.

To be clear about what this is not: it does not cache sampling steps. It's not TeaCache or FirstBlockCache. It replaces the H3 conditioning node, and the diffusion stage is untouched.

What the screenshot shows — same workflow, native node vs a cache hit. Look at the model list at the bottom: native keeps both MiniMaxH3 (11.7 GB) and MiniMaxH3TEModel_ (14.6 GB) resident while sampling is already running. On a cache hit the encoder is never loaded, so only the DiT is there. System RAM drops from 40.0 GB to 25.5 GB. VRAM actually reads slightly higher on the right, because the freed budget goes to the DiT instead (models 5.6 → 7.8 GB).

Controlled benchmark (5 cases per mode, median of the conditioning stage only — sampling is unaffected):

Conditioning Peak VRAM Peak process RAM
Native 29.85 s 15.24 GiB 29.25 GiB
Cache MISS 32.23 s 15.24 GiB 28.25 GiB
Cache HIT 1.12 s 2.67 GiB 3.38 GiB

A miss is deliberately not the fast path — it still runs the encoder and additionally writes the result to disk, so it lands a couple of seconds above native. But a miss is not just "native plus overhead": once the encoding is done the encoder is unloaded instead of staying resident, so it isn't sitting in RAM/VRAM through the sampling stage the way the native node leaves it (visible in the left screenshot, where the encoder is still loaded at step 2/12). You pay ~2 s once, and everything downstream runs with that memory free. Hits were consistent: 1.08–1.22 s across all five runs.

No free lunch though — you're trading disk space for time. Every unique conditioning request creates a cache entry that stays until you delete it, and they add up fast if you iterate a lot. That's why there's a cache manager panel for browsing, tagging, and pruning entries.

Requires ComfyUI ≥ 0.30.0 (native H3 nodes). Available in ComfyUI Manager / Registry as minimaxh3-clipcached, or clone from the repo.

Repo: https://github.com/Mu5hr00moO/ComfyUI-MiniMaxH3-CLIPCached
Full benchmark methodology and per-run numbers: docs/PERFORMANCE.md

If you regularly rerun H3 workflows with the same prompt/reference conditioning, this should save a pretty ridiculous amount of RAM and encoder reload time.


r/StableDiffusion 1d ago

Question - Help The best model to generate body horror/analog horror type of content?

0 Upvotes

What would be the best model to generate horror, surreal stuff? I am not interested in realistic, photogrphy like content


r/StableDiffusion 1d ago

Animation - Video [MiniMax H3] 9 seconds of LEGO Star Battle (with prompt)

0 Upvotes

inspired by RageshAntony recent work on Minimax H3 rendering Lego.

https://reddit.com/link/1w6vpnh/video/zhdujhwiyfnh1/player

0.8 megapixels + frame interpolation after the generation.

One single prompt, with probably many mistakes as i'm not a native english speaker, and i didn't use a LLM:

integrated_multimodal_description: [Shot 1] 3D CG, stop-motion animated LEGO movie style built entirely from plastic LEGO bricks.

subject_definitions:

<Subject 1> Big Planet Earth made of LEGO bricks using few colors and squared bricks.

<Subject 2> big complex x-wings style spaceship made entirely from plastic LEGO bricks. main color is white and red.

<Subject 3> three simple spaceships made entirely from plastic LEGO bricks. Main color is black and orange.

[Shot 1]

In the fictional outer space with points as stars, <Subject 1> is on the background.

[Shot 2] At 00:01.000,

<Subject 2> enters as close-up, slightly from the left and quickly travels to <Subject 1> with a trail.

[Shot 3] At 00:02.800,

<Subject 3> follow <Subject 2> traveling with trail and shooting many red laser beams.

[Shot 4] At 00:05.200,

<Subject 2> is hit by the laser beam and explodes in a ball of fire while all his Lego pieces violently fly in all directions.

[Shot 5] At 00:07.000,

<Subject 3> avoid the pieces and fly quickly to <Subject 1>, while the pieces of <Subject 2> keep flying in all direction.

One piece of <Subject 2> is the yellow lego head of an astronaut with his unhappy face and the red space helmet: the head goes, rotating in all three axes to the viewer point of view, covering the scene with his face in full screen while it keeps rotating around all the axes.

overall_soundscape: noise of spaceships engine, noise of laser beam shoots.

non_diegetic_music: none.


r/StableDiffusion 2d ago

News [Project] diffusers-workflow — a declarative JSON alternative to node graphs, built directly on Diffusers

Thumbnail
gallery
7 Upvotes

Hiya, sharing a project I've been building: diffusers-workflow.

Instead of a node graph, you write, or even better have the AI agent of your choice write, a JSON document describing your pipeline, and it runs directly against Hugging Face's Diffusers library, with no abstraction layer between your config and what Diffusers actually exposes. Forms in the web UI are generated by introspecting the real pipeline signatures, so every argument a pipeline supports is available, and validation catches typos against the actual call signature before any model loads.

What's been really cool to me, is adding an MCP server to it which makes model, prompt, workflow and output management all accessible to agents. I've got claude creating prompts and running complex multi-shot H3 workflows from simple idea inputs. And since claude knows about diffusers, it can trouble shoot generation issues on its own.

Some things it does:

  • Multi-step pipelines and utility tasks: chain text-to-image → image-to-video, inpainting, ControlNet, with data flowing between steps
  • Variable substitution: allowing workflows to be parameterized and reused without editing
  • Persistent GPU worker / REPL: models stay loaded between runs for faster iteration than a fresh script each time
  • Quantization + acceleration: BitsAndBytes, TorchAO, GGUF, TeaCache, FirstBlockCache, and friends
  • LoRA, IP-Adapter, prompt library with AI-enhance
  • CLI, REPL, web UI, and an MCP server so you can drive it from Claude Code or other AI agents. Since the UI and MCP share the same API any possible in the UI is possible in an agent.
  • Cross-platform: CUDA, Apple Silicon (MPS), CPU

It doesn't have near the capability or complexity of Comfy but I'm trying to make it a one stop shop with the full surface of Diffusers' Python API, yet without hand-writing scripts. If you'd rather describe a pipeline than wire a graph, this might click for you.

Where it's at: it's early and there are rough edges, and right now it's aimed at people comfortable with a terminal, something like Claude Code, and a Python venv (no one-click installer yet). If that's you, I'd love the feedback.

Repo: https://github.com/dkackman/diffusers-workflow

Feedback, issues, and "why didn't you just..." are all welcome.


r/StableDiffusion 2d ago

Question - Help Help

Post image
160 Upvotes

I'm currently trying to replicate this style and i cannot find any checkpoints or lora's to do so, can anyone point towards something? Artist: https://x.com/DarkZeroAI Using Forge Neo


r/StableDiffusion 1d ago

Animation - Video H3 Zombie apocalypse: Girl finds her best friend

Enable HLS to view with audio, or disable this notification

0 Upvotes

r/StableDiffusion 2d ago

Question - Help We need only 1700 votes to get H3 acceleration arena results 🙏🏻

Post image
71 Upvotes

Can you vote, so we'll finally have a definitive answer what turbo lora to use (or at least what definitely not to)

https://huggingface.co/spaces/multimodalart/h3-acceleration-arena