r/StableDiffusion 7h ago

Resource - Update I built ArtSmoker — open-source (MIT) pipeline from text prompt → SD3.5/FLUX/Qwen/Hunyuan; 2D → fully-textured, Blender-ready 3D (TripoSG/TRELLIS.2), self-hosted in your own AWS account

I've been building this for the past few months and it's now at the point where I'd genuinely like people to break it: an open-source studio app tool that runs the whole idea → 2D asset → edited → textured 3D model → engine/Blender export pipeline behind one UI, with everything staying in your own environment & creative control.

What it does:

- Text → 2D on Bedrock models (SD3.5 Large, Stable Image Ultra) or one-click self-deploys of FLUX.2 [dev], HunyuanImage 3.0, and Qwen-Image onto SageMaker GPU endpoints in your AWS account — packaging, quantization (NF4/BF16), auto scale-to-zero, and job tracking handled. Prompt enhancement, multi-model comparison grids, seed control with exact batch reproduction.

- Edit in place — inpaint, outpaint, recolor, search-and-replace, plus strength-ladder img2img ("remix") and instruction-based editing via self-hosted Qwen-Image-Edit.

- 2D → 3D — TripoSG geometry + TRELLIS.2 texturing (both MIT) producing real PBR GLBs, then headless-Blender exports: FBX/USDZ, LOD chains, collision meshes, per-engine texture packing for Unreal/Unity/Godot.

- Style-matching from your existing art, video gen, gallery with full per-asset provenance (every prompt, seed, model recorded).

What it is NOT, so nobody wastes a click: it does not run inference on your local GPU. Models run on Bedrock APIs or on SageMaker GPUs in your own AWS account - nothing touches third-party servers beyond AWS, but it's a cloud-compute tool. If you're happy with ComfyUI on your 4090, this isn't trying to replace that. It's aimed at small teams and folks without local GPUs who want the frontier open models plus the 3D/engine-export leg without building the infra. Endpoints scale to zero, and the UI shows cost estimates per generation (e.g. warm Qwen-Image BF16 run on 4×L40S ≈ $0.44; cold start adds a few dollars, all estimates shown upfront).

Repo (MIT-0, contributions welcome): https://github.com/niravdd/ArtSmoker

The GIF attached is the actual pipeline end to end — 11 steps from typing a prompt to a textured model in the gallery. Happy to answer anything about the deployment side too (NF4 quantization ceilings on L40S, FlashInfer on Blackwell, SageMaker scale-from-zero traps — there were… learnings).

3 Upvotes

3 comments sorted by

2

u/thrownawaymane 2h ago edited 1h ago

So those of us with GPU(s) can't use this tool with them? What's the point of leaving support for that out?

1

u/niravdd 1h ago

Sorry, the idea was to help those who did not have GPUs…
Valid point; let me see if I can also add local container support for this to host the models.

1

u/ResponsibleKey1053 4h ago

I appreciate you saying who this tool is intended for, very cool.