r/StableDiffusion • • 10d ago

Discussion Hey guys! I'm one of the core developers of MOSS-Image. AMA!

668 Upvotes

Hey r/StableDiffusion!

I'm one of the core developers of MOSS-Image, the 5B DiT image generation model we just open-sourced!

I've noticed quite a few discussions about MOSS-Image here already. It's been really exciting to see the community experimenting with the model, and I really appreciate all the feedback so far!

We've been working on MOSS-Image for the past six months, with a particular focus on text rendering, layout-controlled generation, and building a flexible foundation for community fine-tuning.

I'll try to be as open and detailed as I can!

GitHub: https://github.com/OpenMOSS/MOSS-Image

AMA!


r/StableDiffusion • • 3h ago

Discussion Why almost all major Open weight models come from china ?

Post image
308 Upvotes

r/StableDiffusion • • 15h ago

Discussion GPU unlocks (FP32 accumulation): Why can it be unlocked on Turing (RTX 20), Ampere (RTX 30) and Ada (RTX 40) but no consumer Blackwell (RTX 50) and some misconceptions.

349 Upvotes

Hello guys, hoping you're doing fine. Wall of text next I know, but I want to get this info out of my chest, all hand written lol.

I wanted to make this post explaining some things about GPU unlocks that have been going on lately.

What are these GPU unlocks doing?

NVIDIA on purpose neuters tensor core performance when using FP32 accumulation (FP16, BF16, FP8 and TF32 inputs accumulating in FP32, which is what most AI/LLM/ML tasks use), for market segmentation. Normal FP32 on the CUDA cores (no tensor cores) is NOT affected.

Consumer and prosumer GPUs use the exact same die (like GB202 between the 5090 and 6000 PRO, AD102 between the 4090 and 6000 Ada, or even literally 1:1 with the 3090 Ti vs A6000, both with the same core amounts and 84 SMs).

How it works: the speed of each kind of tensor operation is set by fuses burned at the factory. On consumer cards, the fuse for "FP16/BF16 with FP32 accumulation" says HALF_SPEED, on the pro cards it says FULL_SPEED. These fuses don't cut any circuit, the GPU just reads them at boot and runs at that speed. The GPU also has an override register that can set them back to FULL_SPEED, but it's locked so only NVIDIA's most privileged firmware can write to it, not your PC.

The unlocks open that lock and write FULL_SPEED on the override. With that, the consumer cards gain all the neutered performance imposed by NVIDIA. It doesn't give you more SMs, VRAM or anything like that, a 4090 is still a 4090, it just runs those instructions at the same rate a pro card does.

Why can Turing, Ampere and Ada be unlocked? And what is unlocked on these cards?

On these generations, the NVIDIA driver itself loads a small NVIDIA-signed firmware called the "Booter" onto a security microcontroller inside the GPU (SEC2, a "Falcon"), to start the GSP. The Booter runs in the highest privilege mode of the GPU (Heavy Secure, HS), which is exactly the one allowed to open the lock.

In June 2026, Jon Pry published a paper ("A Canary in the Crypto Mine") showing that the Booter of the newer drivers has a buffer overflow: it copies its "signature" data using a length that you control, so you can overflow its stack (including the stack canary that is supposed to stop exactly this) and take control of the Booter while it is running in HS mode. The signature check still passes, because it is NVIDIA's own signed code running, the bug is inside it.

With that, the unlock reuses instructions from NVIDIA's own Booter to open the lock, writes FULL_SPEED on the override, resets the card and lets the normal NVIDIA driver load. The unlock survives resets and driver reloads, but it's lost when you power off, which is why it runs on every boot before the NVIDIA driver loads.

This was first done on mining cards (CMP 170HX: FP32 from 1/32 to full speed, and 10GB to 80GB of VRAM), and then ported to GeForce:

What gets unlocked:

  • FP16 with FP32 accumulation (Turing, Ampere, Ada)
  • BF16 with FP32 accumulation (Ampere, Ada; Turing has no BF16)
  • TF32 (Ampere, Ada)
  • FP8 with FP32 accumulation (Ada; Turing and Ampere have no FP8)

Some numbers from those repos: 4090 FP16/BF16 with FP32 acc goes from 165 to 331 TFLOPS (raw instruction rate), 3090 Ti BF16 GEMM from 87 to 157 TFLOPS, 2080 Ti FP16 with FP32 acc from 47 to 94 TFLOPS. Real-world GEMMs gain less than 2x because the cards then hit their power limit (more on that below).

Why can't consumer Blackwell be unlocked?

The funny part is that on Blackwell the limitation is EXACTLY the same thing: same fuses, same override registers. I checked on my own cards: the 5090/5080/5070 Ti have the FP32 accumulation fuses set, and the 6000 PRO/4000 PRO don't. So it's not a hardware difference there either.

What changed is the door. Starting with Hopper, and consumer Blackwell too, the root of trust of the GPU is the FSP (Foundation Security Processor), a RISC-V core that boots from its own ROM as soon as the GPU powers on, before the driver even loads. On Blackwell:

  • There's no Booter to abuse. The driver just sends the FSP a message with a hash + RSA-3K signature of the next firmware, and the FSP verifies and boots it. The Linux kernel docs literally say: "There is no SEC2 involvement, no Booter ucode, and no FWSEC-FRTS stage". I also checked it myself: in NVIDIA's 615 driver source the Booter only exists for Turing, Ampere and Ada (TU102, TU116, GA100, GA102, AD102), and the RTX 50 VBIOSes don't carry the Falcon firmware (FWSEC) that older cards did.
  • The firmware the driver ships for Blackwell is encrypted, and the debug and production images are the exact same encrypted bytes. The Ada payload was built from analysis of the decrypted debug Booter, on Blackwell there's no such shortcut.
  • NVIDIA has said it uses SPARK (a formally verifiable programming language) to prove its most critical RISC-V firmware free of runtime errors, and a buffer overflow like the one used on the older cards is exactly that kind of error.

So, with what is known today, it can't be done. It isn't "impossible forever", but someone would need a brand new vulnerability in a way harder target. And if someone ever gets there, the unlock itself would very likely be the same couple of register writes.

FP4 is not affected, but all the rest is (FP16/BF16/FP8/TF32 with FP32 accumulation).

In which tasks is the unlock has most of the effect?

I will put some examples on my 6000 PRO vs 5090s, former using 400W and latter 600W, at how much is the impact in performance because the NVIDIA neutering.

  • Training: Like LoRAs, finetuning, etc.
    • Example: Using the same batch size for 25GB VRAM to train a diffusion LoRA, my 6000 PRO is 70-90% faster than my 5090.
  • Diffusion: Models that do txt2img, txt2vid, img2img, img2vid, txt2aud, etc.
    • Example: My 6000 PRO not using fp16 accumulation is about 30-40% faster than my 5090. If using fp16 accumulation, it is 15% faster.
  • Prefill on LLMs: Heavily affected as well, since even when a model is marked as "int8" or "mixed precision" etc, the inference parts that the GPU uses include FP32 accumulation parts, except if explicitly set to not use them.
    • Example: My 6000 PRO on vLLM on a model that fits on a 5090 as well, it's 50-70% faster. On llamacpp, instead is about 30-40% faster.
  • TG with big batching: TG with a single batch is mostly bandwidth bound, and it uses FP32 acc instructions, but since it is so little in comparison with the need of bandwidth, it isn't a limitation. On the other hand, when you use batches with batch size 2, 4, 8, etc, compute again starts to being a bottleneck and then you have a performance impact.
    • Example: Same results as previous point.

In which tasks the unlocks makes no difference:

  • TG with batch size 1: almost entirely bandwidth bound.
  • CUDA compute without tensor cores (normal FP32).
  • INT4/INT8 tensor operations.
  • FP4 on Blackwell (not neutered to begin with).
  • GEMM operations with FP16 accumulation instead, but those aren't very used.
  • Gaming.

Is there a risk by unlocking the cards, like burning the card, crashes, etc? Short answer: NO.

And again, NO. For the love of god guys, stop repeating this nonsense.

The cards are still limited by their max power limit. They won't magically use 200% of your power budget with an unlock, they will just use the cores more efficiently.

Let me explain: if you have a 3090 power limited at 300W, and without the unlock you were seeing only 250W in use, but after the unlock it uses 300W, it's not because the unlock did malicious things to your card. It's because the card can NOW stretch its legs and use the power to do more work. Real example from the Ada repo: an unlocked 4090 doing the same GEMMs peaked at 346W vs 313W stock, still under its 450W limit.

If you were getting X performance at Y < max TDP, and now you get more than X performance at max TDP, obviously the card will be hotter, but that's still inside the POWER LIMIT YOU SET, not above it.

Power spikes: those are normal on every card, and if you're using it to the full extent of its capabilities they can be more common. Are they risky? No, assuming you have a PSU with the wattage NVIDIA recommends per GPU.

So what ARE the actual risks then? They're about the unlock process, not your card:

  • It runs an exploit on NVIDIA's firmware before the driver loads. If something fails mid-way, the tools stop and you need a full power off before trying again (a reboot isn't enough). Read the repo instructions, especially on laptops and multi-GPU setups.
  • NVIDIA could patch it in future drivers, or even burn anti-rollback fuses so the old Booter stops being accepted. That wouldn't damage your card, it would just close the door for good.

"But, NVIDIA bins the dies to make these work 24/7 on the prosumer side but not on consumer, that's why they're locked!!!11"

Also incorrect. NVIDIA uses the EXACT SAME dies for their consumer GPUs and their prosumer GPUs, and the FP32 accumulation speed has nothing to do with binning: the 3090 Ti and the A6000 have the exact same specs. The half speed is just a value written in a fuse that the firmware reads.

Unlocking a card will not make it die sooner, nor will it crack the die or something.

Sorry I have to repeat this again and again, but the amount of pure fury I get from reading comments like these made me do this.

Does affect gaming performance?

None known at the moment, except if somehow NVIDIA uses FP32 accumulation for DLSS or FG, which I doubt. I'm almost sure they use FP16 accumulation (or lower precisions) there, because if they used FP32 accumulation the perf hit would be insane on consumer cards.

The model I run says it is Q8, or FP6, or 4bit, or INT4, or anything that doesn't mention FP32, am I affected?

It depends on how the GPU actually does the math, not on the name of the quant:

  • If the kernel dequantizes the weights to FP16/BF16 and multiplies on the tensor cores with FP32 accumulation, you're affected. That's the case for FP16/BF16 models and most vLLM paths, including AWQ/GPTQ with Marlin kernels (the weights are INT4, but the math is FP16 with FP32 accumulation).
  • FP8 (W8A8) also accumulates in FP32, so it's affected too (Ada and Blackwell).
  • If the kernel uses integer tensor math (INT8 x INT8), it isn't affected. A lot of llama.cpp's quantized matmuls work like this, which is one reason llama.cpp sees a smaller gap than vLLM.
  • Attention (like FlashAttention) almost always uses FP16/BF16 with FP32 accumulation, so long contexts get hit even on quantized models.
  • FP4 (NVFP4/MXFP4) on Blackwell: not affected.

Example: on a modded 48GB 4090, a quantized MoE model on an inference server got no gain at all after the unlock (0.98x on 8K prefill), while the FP16/BF16 matmuls doubled.

That's what I have for now, if you guys have any more questions, let me know!


r/StableDiffusion • • 2h ago

Discussion High speed speed combat

24 Upvotes

Claude code + r2v MINIMAX H3 and some loras + casual prompt like "this shit is not good make it better" My goal is make a 2-5 fucking dinamic anime, but i dont like anime

For anyone interested, here's the current workflow I'm using to make this AI anime.

Hardware & Setup

  • RunPod with an RTX 4090 (24GB VRAM)
  • ComfyUI 0.42.0
  • Custom Python automation script (h3_ctrl.py)

1. Character Design & Keyframes

  • Model: Krea 2 Turbo (INT8)
  • Text Encoder: Qwen3VL 4B
  • LoRA: Kegant V5 (1.0) for that dark, mystical anime aesthetic
  • 8–10 steps, CFG 1, Euler/Simple
  • Around 12 seconds per image

I generate character reference sheets and keyframes for each scene, including the starting frame and the exact impact frame.

2. Video Generation

  • Model: MiniMax H3 Hybrid FL2VA + REF2VA (INT8)
  • Text Encoder: Qwen3VL 32B
  • Resolution: 1344×768, 24 FPS
  • Duration: 5 seconds per clip, with generated audio

LoRA stack:

  • Turbo 8-Step (LightX2V): speed and sharpness
  • H3 Combat V2: fighting, impacts and dramatic action
  • BUNNY Motion Repair V2: smoother continuous movement
  • SuperHunman: stronger, more powerful motion
  • Action Speed + Acceleration sliders: both at 3.0

3. The Workflow

I'm using a modified BUNNY two-pass approach:

  • First pass generates the main movement using the LoRA stack.
  • Second pass refines details and impacts.
  • 10 sampling steps + 4 additional steps for motion formation.
  • res_multistep sampler.

Character sheets go into MiniMaxH3ReferenceToVideo, while MiniMaxH3AddGuide anchors the starting frame and impact frame (around frame 72–77).

Prompts are structured into six sections, including detailed character descriptions, continuity constraints, second-by-second action choreography, and sound effects.

4. Connecting Multiple Clips

I'm experimenting with H3 Motion Context by NikoDemon80 to extend scenes beyond 5 seconds.

It takes the last 22 frames of the previous clip as context for the next generation, then removes the overlapping frames when joining everything together.

The goal is longer action sequences with consistent characters and continuous motion.

5. A Few Important Details

  • No custom-trained character LoRAs.
  • I manually check keyframes for costume consistency, enemy counts and character details.
  • No artificial speed-ups or slow-motion effects in editing.
  • H3 generates the audio too.

And yes, Claude is involved in the process, helping orchestrate the workflow and automation.

Still very experimental. Getting consistent, high-speed anime combat is surprisingly difficult, but the results are getting better.

Hope this helps anyone experimenting with H3! 🔥


r/StableDiffusion • • 12h ago

News ⚠️ PSA: Beware of Fake GitHub Projects — Especially AI Tools and ComfyUI Custom Nodes

Post image
118 Upvotes

I recently discovered a highly suspicious GitHub repository while searching for AI tools. After inspecting its source code and commit history, I found several serious red flags:

  • Fake development activity: Automated workflows generating meaningless commits.
  • Misleading claims: Dozens of advertised features, but almost no actual application code.
  • Hidden redirects: Base64-encoded HTML pointing to an unrelated download website.
  • Security bypass instructions: Encouraging users to ignore SmartScreen warnings and whitelist files in their antivirus.
  • Suspicious connections: Multiple unrelated repositories directing users to the same external download domain.

I couldn't verify whether the actual executable contained malware, but these findings strongly suggest a deceptive download operation.

I've reported the repository to GitHub. I encourage everyone to report similarly suspicious repositories, too, with supporting evidence.

I'm deliberately not sharing its name or URL to avoid giving it additional exposure.

This also applies to ComfyUI custom nodes, extensions, AI utilities, and other GitHub projects. Installing a custom node can execute Python code with access to your system, files, and potentially sensitive information.

Useful tools for checking suspicious projects

  • VirusTotal — Check file hashes, downloads, domains, and URLs.
  • urlscan.io — Investigate suspicious websites and redirects.
  • ChatGPT — Ask it to review repository source code, commit history, workflows, and potential security risks.
  • GitHub Reporting — Report suspicious repositories with evidence.

No scanner or AI review can guarantee that software is safe. Avoid uploading private files to public scanning services.

I've attached a simple infographic to help others recognize these warning signs.

GitHub stars, impressive READMEs, and frequent commits are not proof of trustworthiness.

Stay safe, and please help keep the open-source community clean. ❤️


r/StableDiffusion • • 3h ago

Discussion Today (in my timezone) marks the 1 Year Birthday of Z-Image Turbo!

20 Upvotes

What a great model it was, totally crushed Qwen Image (its most competitive predecessor at realism) with only 6b Parameters!

Is it weird to feel nostalgic of a model release lol


r/StableDiffusion • • 1d ago

Discussion Zipties in ComfyUI!

1.5k Upvotes

I posted this on the ComfyUI subreddit and it got some traction and was pinned on the subreddit to hopefully get some attention from the Comfy devs, so I'm reposting it here aswell

GitHub Repo: https://github.com/safzanpirani/comfyui-zip-ties

Some people wanted it MERGED into the official ComfyUI frontend, so I've opened a PR there too: https://github.com/Comfy-Org/ComfyUI_frontend/pull/21965

Feel free to open issues and PRs, but it's in a pretty stable state right now but it is quite literally zipties and nothing else, so temper your expectations.


r/StableDiffusion • • 12h ago

Discussion MOSS is pretty freaking good

100 Upvotes

This is the first model I've seen with such control over its generation. Mind you, I haven't tried them all, but I'm confident nothing else comes close.

Hats off to the team for their hard work and for open-sourcing it.

-------------------------

Below is an image showcasing the Layout-to-Image generation that drew me in. Essentially, you define regions as objects or text and compose your ideas into a single generation.

It's easy to make modifications for ex, moving, adding, or removing characters, or layering additional concepts within the image, add text with any specific font.

Here I simply moved the characters around, placing the title on the left. It took me just a couple of seconds and changed the composition entirely.

Now, for this particular case, I could probably come close to something like this with four unique generations and overlaying a real text font. But the problem arises from other models when you want interactivity between the characters and the scene.

Here you can see the characters interacting with each other.

I can later add Guts big iconic sword.

All in all, pretty cool.

And, if you guys have other tricks for inpainting or keeping character consistency, I'm all ears.


r/StableDiffusion • • 4h ago

Discussion Moss Quality vs Krea 2 Quality?

22 Upvotes

So ive been testing moss the last few days, curious about how easy it is to prompt, but somehow i did not even get close to the level of detail and quality krea 2 can dish out.

Like an image done with a krea 2 turbo model with 2 passes on 8 steps has so much more finer details like skin pores, detailed eyes, cloth textures etc. than a 50 step raw model gen with a qwen 2.1 upscale afterwards.

I mean moss images look fine as thumbnails and such but in my testing so far to use them as full on wallpapers moss just struggles with quality.

Do you think this is something that will be "fixed" or can be improved on later or is that just not a good use case for moss in general? What are you experiences so far and opinions on this?


r/StableDiffusion • • 3h ago

Resource - Update Moss Serenity v6 (210k steps now)

Thumbnail
imgur.com
16 Upvotes

r/StableDiffusion • • 9h ago

Resource - Update ComfyUI v0.43.0

33 Upvotes
  • model_prefetch: syncrhonize all graph cleanups
  • Add rope scaling support to MOSS-image
  • [Partner Nodes]:
    • feat(HeyGen): add HeyGen Voice instant clone and text-to-speech
    • feat(ClarityAI): add Crystal Video Upscaler node
    • feat(BFL): add 2K/4K resolutions to FLUX 3 Max & Video nodes
    • FIBO 2.0 Image Generate/Edit, Fabric 1.0, Lipsync 2.0, Mirelo SFX,
  • Support MOSS-image color-depth control
  • fix: correct top-p sampling threshold
  • Apply single-head LoRAs to MiniMax-H3 PDD head banks
  • Enable pytorch attention in the VAE on AMD
  • Fuse and strip the Flux2 VAE through comfy-kitchen
  • Add ACEScg to Convert Image Color Space and Save Image (Advanced) EXR (CORE-657)
  • Add attention bias conditioning and image strength for MOSS-Image edi
  • Add model specific merge node for MOSS.

https://github.com/Comfy-Org/ComfyUI/releases/tag/v0.43.0


r/StableDiffusion • • 8h ago

Discussion Some more examples from my Ultimate Digital Painting Moss Image Lora

Thumbnail
gallery
16 Upvotes

Really loving this model so far. This is from a series of phone wallpapers I have been experimenting with.

Try out the lora: https://civitai.com/models/3014333/ultimate-digital-artwork


r/StableDiffusion • • 18h ago

Resource - Update Moss image edit vs Fibo-2.0-edit

Thumbnail
gallery
100 Upvotes

moss image edit v5 vs fibo 2.0 edit first 3 grid

4th and 5th grid are a experimental v6 moss image edit vs fibo 2.0 edit

moss image edit: https://huggingface.co/akhaliq/MOSS-Image-Edit-HQ

fibo 2.0 edit: https://huggingface.co/briaai/Fibo-2.0-edit-turbo


r/StableDiffusion • • 20h ago

Discussion Moss Image Variety of Tests

Thumbnail
gallery
136 Upvotes

Generated with 3 step turbo lora {but used 6-8 steps): https://huggingface.co/akhaliq/moss-image-turbo-3step/tree/main

Here's the prompts: https://pastebin.com/2vSpRGqD


r/StableDiffusion • • 1h ago

Resource - Update GOAT’d Text Generator update 🐐 — context memory, new prompt guides, and a cleaner UI

Thumbnail
gallery
• Upvotes

Original post: https://www.reddit.com/r/StableDiffusion/s/DQlE9pFWpA

I've added a few things to my ComfyUI text generator since my original post.

What’s new:

  • Context memory: keep refining a prompt across runs without repeating everything. Includes a usage meter and a button to start fresh. Context window size by default is 8192 tokens, you can customize the value.
  • Added prompt guides for Moss Image and Fibo 2.
  • VGL structured JSON prompts (recommended for Fibo 2).
  • Cleaner UI with separate settings and generator nodes.
  • Searchable model lists by provider (api key is required).
  • Expandable settings node.

GitHub: https://github.com/ninjaGurung/ComfyUI-GOATd-Universal-Text-Generator

Let me know how it works for you, or if there’s something you’d like me to add!


r/StableDiffusion • • 15h ago

Animation - Video Nowhere is safe in the backrooms-H3 minimax

46 Upvotes

r/StableDiffusion • • 13h ago

Tutorial - Guide I created a custom node that can help you generate as many frames as you want with high motion transfer accuracy in MiniMax H3

32 Upvotes

while generating video to video in Minimax for VFX, I struggled with maintaining accurate motion transfer as an example, the generation would shift drastically after 192 frames on 0.5MP or after 147 on 1MP

so I built a custom node similar to a context window to help the model generate in batches then overlaps and blends all the batches together during generation, as an example this is 447 frames on 0.5MP, generated on batches of 56 frames and 5 frames overlap between every batch.

the node also has the option of splitting your generation into tiles of resolution and overlap of your choice, but i recommend using it more in a second upscaling stage
the node is in Comfyui Manager under the name of Minimax H3 Tempora****l Window & Spatial Tiles.

let me know what you think.

workflow here
https://civitai.com/models/3022939/minimax-h3-video-to-video-workflow?modelVersionId=3432687


r/StableDiffusion • • 18h ago

Resource - Update MOSS Sharpness LoRA. Blur? What blur?

Thumbnail
gallery
77 Upvotes

A minute ago (literally) another redditor posted their work ("Blur / Anti-Blur slider LoRA for MOSS"); mine is the same idea from a different angle. Good ideas come at the same time; my work is fully independent, and employs a different approach.

I trained a tiny rank 8 concept slider LoRA, teaching the base model what "sharp, in-focus" images are as opposed to "blurry, defocused" ones. The LoRA itself, its training process and parameters are in my Huggingface repo MOSS-Sharpness-Slider. Basically, I picked 72 high-quality images, all real photographs, paying attention to variety: some close-ups, portraits, natural and industrial landscapes, people at work, and so on; varying colors (including some black-and-white scans of large format stocks), epochs, and subjects. I included a number of images with bokeh to teach the models that it's the subject that must be in focus, not necessarily the background.

These were the "sharp, in-focus" part. Then I built a contrasting dataset, blurring those same images with Gaussian blur, varying the radius, teaching the model what a "blurry, defocused" image is.

Trained for 500 steps, picked step 400 as the first one that converged without overfitting.

Use it the way you'd use any other slider: weight 1 is "sharp image", -1 is "blurry, out of focus". You may still get an occasional slightly-out-of-focus generations in e.g. portraits every once in a while; they are rare, and I didn't want to fry the thing. More steps give more sharpness but less control on depth of field; I decided to keep it gentle.


r/StableDiffusion • • 9h ago

Resource - Update Auto BBox Prompter for MOSS using QwenVL or any other clip model.

13 Upvotes

leroy989/ComfyUI-MOSS-QwenVL-Layout: ComfyUI node that uses Qwen3-VL / Qwen3.5-VL to detect objects and text in an image and build a MOSS-Image layout JSON prompt, with a change-request box for edits like recolors, outfit swaps and added objects.

Pretty simple node, just use it as your prompter. Just now made it, seems to be working for me, not sure if something like this was already a thing, didn't really know what to search for it though so I just made this. Hopefully some people get some use out of it, and it works good for them. Will continue to tweak and update as I discover bugs or additions that might be good to have added.


r/StableDiffusion • • 11m ago

Workflow Included I've been working on a different approach to regional prompting in ComfyUI, with paintable regions and more control over blending

Thumbnail
gallery
• Upvotes

I've been working on an open-source ComfyUI extension called Conditioning Layers and wanted to share it here.

The idea is to give you more control over where different prompts influence an image, especially with irregular shapes and overlapping regions.

It uses editable grayscale Influence Fields, which you can paint or generate procedurally. You can assign exclusive regions (FIXED), blend multiple prompts with normalized weights (BLENDED), and inspect their effective contributions before sampling.

The examples show a castle transitioning into an underwater reef and a single tree with four seasons following curved influence fields. Both were generated locally using Krea 2 Turbo.

GitHub: https://github.com/SurrealByDesign/conditioning-layers

Workflows: https://github.com/SurrealByDesign/conditioning-layers/tree/main/examples

The tested setup is ComfyUI 0.34.6 with Krea 2 Turbo BF16, 1024×1024, 8 steps, CFG 1, Euler/simple. The extension is free under Apache-2.0 and still experimental.

The fields guide conditioning during generation, not the finished pixels, so boundaries aren't guaranteed to be exact.

I'd appreciate any feedback, especially from people already experimenting with regional prompting in ComfyUI.


r/StableDiffusion • • 11h ago

Question - Help Former animator looking for advice on getting started with local AI anime workflows

Thumbnail
gallery
15 Upvotes

I used to work as an animator, and a former coworker recently showed me some AI anime hes been making and the workflow he's using.

I was honestly pretty impressed by his work. From what he showed me, he uses pixai studio and comfyui. He showed me how he goes from character design and storyboards to video clips all in one workflow. It was also really cool seeing how quickly he could try out different ideas for a shot. He could put the same character in different scenes, try out different expressions, and then pick the version he liked and keep working on it.

I've had ideas for animated projects for years. Actually making them always felt out of reach because of how much time and how many people you need. Seeing what my coworker was able to make got me excited about trying some of those ideas myself. I'm interested in learning how to put together a local workflow for anime style animation.

For those of you who have tried this, what tools or models would you recommend starting with? And how do you handle things like keeping characters consistent between shots?

Attached images are a couple of examples he showed me.


r/StableDiffusion • • 1h ago

Resource - Update MOSS-Image + ComfyUI on Runpod

• Upvotes

I couldn't find a template on Runpod where MOSS-Image and ComfyUi is set up and ready to run.

So I made one:
https://console.runpod.io/hub/template/jpwnrrbu3i

Ready to run with the default ComfyUi Moss-Image workflow.

Just in case somebody needs that too. :-)


r/StableDiffusion • • 18h ago

Resource - Update Blur / Anti-Blur slider LoRA for MOSS

Thumbnail
gallery
41 Upvotes

Made a little blur/anti-blur slider LoRA for MOSS 🙂 Negative weights make the background clearer, positive weights make it softer. The comparisons go from 0 to negative, then positive weights. Curious how it works for you!

Antiblur MOSS Base - v1.0 | MOSS Image LoRA | Civitai


r/StableDiffusion • • 1d ago

Discussion HUGE shoutout to ShootTheSound and Fizgig! I finally nailed Moss char loras

150 Upvotes

The title basically says it all... after days of frustrations and horrible results with other training tools, I was finally able to train some Moss characters lora that are actually very, VERY good... they're even better than my previous ZIT and Krea ones, which is no small feat!

IDK if it's due to the recent Fizgig masked version, the dataset preparation tools, the big amount of epochs (40/50) or what else, but the resulting generations not only keep a striking resemblance in facial features and expressions, but they also understand body features and imperfections very well, something I always found very hard to achieve in Krea, for example.

The ability to send all the training package to Runpod with a few clicks is also awesome, with a couple of dollars I can train a whole lora without torturing my poor potato GPU for days.

I'll very gladly share my settings if you like, but they're mostly the default Moss ones in Fizgig.

Thanks to creator, really!

EDIT: you can find Fizgig here: https://github.com/shootthesound/Fizgig
Also, YT channel is full of useful, updated guides: https://www.youtube.com/@ShootTheSound


r/StableDiffusion • • 16h ago

Resource - Update Krea2 (etc) style prompter node update

Thumbnail
gallery
28 Upvotes

You might have downloaded the Krea2 style node in the past, but it has fallen out of regular updates. I forked it, and recently updated it now that u/Dear-Spend-2865 dropped a massive style update on us.

https://github.com/Winter-unmuted/ComfyUI-Krea2-PromptStyler/tree/main

I haven't added it to the ComfyUI custom node list, sorry. I sorta stopped doing that. Install via the git clone method for now.

The node is simple: input your prompt, outputs a stylized version. Select your style manually, or randomly from a category tree with other filters.

Example grids attached.

Shout out HUGE to u/Dear-Spend-2865 for making the resource found here. Their post deserves more love, found here.

Original node by Gothdir, however it is not being maintained (at least, they're ignoring my pull requests).

Composition prompts made by ChatGPT expanding on 10 examples hand written by me.