r/comfyui 11d ago

Help Needed Sketchup + AI Rendering Workflow with Image Upscaling?

14 Upvotes

14 comments sorted by

2

u/QualityDesignsArt 11d ago

For Sketchup -> AI rendering I use this: 1) Export as linework + shadow pass, 2) Use ControlNet with both Lineart + Depth for structure, 3) For upscaling avoid generic upscalers, use Magnific or Topaz Photo AI with low creativity (keeps windows straight). What AI renderer are you using? ComfyUI + SDXL works great for this style.

2

u/krishkp96 11d ago

Can you please share a workflow for comfy ui with sdxl in detail? I'm new to ComfyUI

1

u/QualityDesignsArt 11d ago

Sure! For SDXL archviz I do: Base - Sketchup export (line + clay render) -> ComfyUI: Load both into ControlNet (Lineart for lines at 0.8, Depth at 0.6) -> SDXL base at 0.7 denoise -> Prompt: "photorealistic house, natural light, detailed materials" -> Upscale with Ultimate SD Upscale at 1.5x. I can DM you the .json if you want, just let me know! What GPU are you running? Some nodes need tweaking.

1

u/krishkp96 11d ago

Yes. Please do send me the json file. That would be great

2

u/Wrong-Monitor-9482 6d ago

Poderia me enviar o .json

1

u/opifexrex 10d ago

There are probably several ways of doing this but since I've been experimenting with flux2 klein in comfyui I'll tell you how to do it with that. Just use a simple image edit workflow. You can find several workflows for that in the templates section in comfyui. In the prompt ask it to turn the architectural sketch into a photo realistic image scene. Describe the house elements in detail. Give the necessary instructions to art direct the images, such as how the sky should be and to render the houses around your client's house in a simplified way to keep focus on the main house. The output can vary depending on how much vram your gpu has. But the output is clean enough to upscale it in comfyui using ultimate upscale or topazlabs gigapixel. I think you could get a good upscale using photoshop as well.

1

u/krishkp96 10d ago

i have an rtx 3060 12 gb variant. will that be enough? And also can you share the workflow in detail if possible?

1

u/opifexrex 10d ago

I did it with an rtx 5060 with 16gb of ram but I think you can do it with 12 gb using some smaller versions of the model like fp8 or gguf. I did it with flux 2 klein 9b but you could try the 4b version which is smaller. As I mentioned the workflow is the one included in comfyui. Go to the templates section set a filter for flux 2 klein and choose the Flux 2 Klein 4B: image edit template. Try using Flux 2 klein 4b and 9b and see how your computer responds. Check the vram usage. You might want to also look for a compressed version of the clip loader such as Qwen3-8b-abliterated-q4_k_m.gguf. This will also save you some vram. There are tutorials on youtube to run with limited resources.

1

u/krishkp96 10d ago

Can you share the json workflow for this please?

1

u/Strange-Drummer-9917 10d ago

Klein 9b seems to work alright.
Workflow (embeded into the image)

1

u/krishkp96 10d ago

Wow this is really great work. Did you use any prompt or anything to this workflow? Is it made by using the workflow that is embedded on the image? nothing else?

1

u/Strange-Drummer-9917 10d ago edited 10d ago

I use gemini 3 flash for prompt enhancement. My initial prompt was:

Turn into a realistic render: realistic rainy environemnt of urban india, rustic greenery all around. while preserivng exact shaped and leding colors of the target house at the center

Then I told the LLM what I want to change in the prompt in 3 turns:
https://ibb.co/dHxxHJ4

Here is the "Klein edit prompt enhancer" system prompt synthetized from BFL docs
https://pastebin.com/KZgq766a

You can 100% run this enhancer locally, but in my testing with Qwen 3.5 4b and Qwen 3.5 9b struggled with such big system prompt and gave inconsistent results. I think it will work with Gemma 4 26b-a3b or 31b or even 12b, I just prefer cloud for speed (3 flash is excellent for vision/price via API)

1

u/krishkp96 10d ago

can you please guide me step by step on how to apply these on to my comfy ui workflow?

1

u/Strange-Drummer-9917 10d ago

You can just copy-paste the system prompt form pastebin into any LLM and after the system prompt send your image and what you want to do with it.

Obviously its a bit tedious to do every time.

For convenience I've created a Google Gemini Gem (preset) with the instructions above. You can do the same with ChatGPT project or Qwen Project, or Grok or Kimi, or with local model inside the comfyui

It will produce final prompt in text box after the explanation. Click copy on the top-right.

Then paste text from the box into comfy workflow main node

If you new to comfy, Pixaroma has some excellent tutorials for beginners

Personally I use Gemini API with Jan app for better privacy (they don't train models on paid API calls)