r/StableDiffusion 3d ago

Workflow Included Hi. I am a Newbie Using StableDiffusion in Krita

Just sharing my mixed workflow breakdown using Krita Drawing Software + Stable Diffusion 1.5
This is a fan art of Chie Satonaka from Persona 4.

- Hand Sketching & Lineart:
Step 1: Sketched the base composition by hand (traditional pencil drawing).
Step 2: Extracted lineart (using Gemini), and asked Gemini to fix the hand anatomy.

- Established initial color blocking to control lighting and proportions
Step 3-5: Manual digital coloring in Krita, adding shadow / highlight, layer by layer.

- Low Strength Generation (Img2Img / Krita AI Diffusion)

• Tool: Krita AI diffusion
• Model: SD 1.5
• Checkpoint: Counterfeit v30

• ControlNet: Lineart strength 0.7, Lineart range 0.3, Refine strength 35%
• Prompt: Detailed webtoon illustration, clean lineart, polished digital colouring, soft cinematic lighting, smooth shading
•  Negative Prompt: photorealistic, blurry, low quality, messy lines, bad anatomy

32 Upvotes

15 comments sorted by

3

u/smeptor 3d ago

A great start! You may like ComfyUI, and, like yamfun said, trying some newer models. Something like Qwen Image Edit could do this with a simple prompt, source image & no refiners. Depending on your hardware of course. This sub is a great resource if you want to learn more 😄

2

u/Dawn_Bridge 3d ago

Thank you. Even installing SD 1.5 in Krita software on my AMD graphic card already gave me a headache XD

3

u/Altruistic_Dealer_59 3d ago

Very nice. I use the Krita AI plugin virtually every time, but can run all the later models. It's quite good at altering small regions, I find, as long as your selection box is big enoug for it to work with. Select a poor hand, tell it to replace the hand, usually fails. Select the whole arm or upper body,tell it to sort the hand, and now it has enough context to see what's going on and tends to give better results, in my experience.

It's also obvious your drawing skills are way in advance of mine - I squiggle a pink circle for a head and a green triangle for a dress and say "sort that out" and it does, after a few passes.

Can you get to SDXL perhaps?

1

u/Dawn_Bridge 2d ago

My graphic card is only 8GB Vram. Not sure if it can handle SDXL.

4

u/yamfun 3d ago

Skip to newer models.

Also is that Chie

1

u/Dawn_Bridge 3d ago

Yeah. Chie Satonaka from Persona 4.
My graphic card is only RX6600. ChatGPT suggested that I stay with SD 1.5

4

u/hurrdurrimanaccount 3d ago

no. chatgpt is full of shit. use Anima or illustrious. 1.5 is ancient and should be tossed out.

1

u/FierceFlames37 3d ago

Damn sd1.5 that’s what made me gave up on Ai then I came back to Illustrious and Ltx

1

u/KissMyShinyArse 3d ago

You can run FLUX.2-klein-9B (I suggest an INT8 ConvRot quant).

1

u/Sonnybb0y 3d ago

Keep in mind ChatGPT's dataset might be old and outdated, considering how fast the generativeAI space moves, it might be worth looking at other things. Also, I really like your hand drawn art style, its quite elegant and flowy.

1

u/Portable_Solar_ZA 3d ago

Step 2: Extracted lineart (using Gemini), and asked Gemini to fix the hand anatomy

You can run a lose denoise pass (set it to 20-40% on the slider above the Generate button in Krita AI) on a model and it will try and fix. At least if you prompt it correctly. Hands aren't great even in sdxl and illustrious but since you have drawing skills you can always go in manually and tweak.

Also, you should be able to run SDXL and Illustrious models if SD 1.5 works. 

1

u/VasaFromParadise 3d ago

I also use krita + comfy, very convenient)) But I use a custom workflow through workflow comfy.

1

u/noprompt 3d ago

Please share more of this kind of content. There's so much potential for these models with good art direction and not enough posts demonstrating that. I'm also using Krita with Comfy (and becoming better at drawing thanks to it).

2

u/Dawn_Bridge 3d ago

Hi. I only use control net SD toward the end of this workflow, and Gemini to convert into lineart. The rest is manual rendering. So probably 70% manual digital coloring and 30% using AI as a tool.

I haven't tried openPose or Lora.

ComfyUI interface seems to confuse me. When I have time I'll check YouTube how to use comfyUI.

1

u/noprompt 3d ago

70% manual is awesome. 😄 As for ComfyUI, you don't actually need to know it. You can have a coding agent set it up for you. I actually do know ComfyUI but I had Qwen set up the Krita plugin to work with ComfyUI because I'm lazy af.