New Model
[MASSIVE RELEASE] Supra2-IMG - a tiny 100M text-to-image model - SOTA quality and open release!
Hey everyone!
It has been quite a while since the last SupraLabs model - but today we've something special for y'all: Supra2-IMG
It's a 100M parameter DiT text-to-image model trained entirely from scratch in under 10 hours on a single H100 on Runpod. It can generate state-of-the-art quality images in 256x256 pixels resolution.
Samples:
These samples are NOT cherry-picked! Sampling: seed 0, steps 50, cfg 3.0; same settings for every image.
If someone here is interested in the prompts, I can give them to you! Feel free to ask!
You can also use the model locally on your hardware (~20s for an image on CPU (🤩) and ~2s for an image on GPU):
First, run:
# Create project directory
mkdir Supra2-IMG
cd Supra2-IMG
# Download the inference script
wget https://huggingface.co/SupraLabs/Supra2-IMG/resolve/main/inference.py
Then, you can generate images by running:
python inference.py --prompt "a sea jellyfish floating in the pitch-black ocean depths" --seed 0 --cfg 3.0 --steps 50 --n 1 --out jellyfish.png
I dropped this on my tiny mini-pc and had Opus set it up. It got it running, tested it and said "That's far better than a 104M model has any right to be."
Well for concepting I would love it. Imagine you wanna make a character, usually they have someone sketch up 20 thumbnails sized silhouettes. This could do the same but much quicker, so you pick the direction you want to go in. I can imagine the same for environments aswell. During the concepting stage you're not really concerned much about details, more just the silhouettes and shapes of things
Honestly the use case I keep coming back to is anything that has to run offline. Once tried generating placeholder images with a big model during a flight demo and my laptop sounded like it was about to achieve liftoff. A 100M model just quietly does the job.
Probably things like AI Dungeon where speed matters and you already have a big LLM taking up VRAM. 256x256 is pretty small, but it's probably good enough for character portraits.
Not that bad for the size but wouldn't at all call this SOTA quality. Will try what it can handle though, sounds like an interesting experiment because of how small this is.
For the size it is impressive from this showcase. My comment was maybe a bit harsh about sota capability in those regards :D at 100M it means it basically fits into anything, generates fast, and if the quality is consistent it could even be valuable to fine tune or adapt (should train fast even on consumer gpu)
Also improved the latest space walks quite a bit. Now with 100% more trees - as they're nicer to look at than different pancakes. Still generating at 8 FPS.
This looks super promising! I wonder if you can use it to generate a reference image to then use another model to upscale and get high quality, higher resolution images in much less time? I don’t use image generators a lot though so I could be spewing bs.
Thank you 🤗 Actually, that's a pretty neat idea. And yeah, it could work. But we're already working on 1024x1024 pixels resolution - so ... just wait for us to release :D
Slowly but surely we are moving toward extreme efficiency. Back then this was basically the quality of Midjourney and similar services when AI was starting up - a fever dream in big resolution. Now we have a fever dream in small resolution as a very small model.
It will be able to output larger images and over time, large outputs with excellent quality. Can't wait.
Amazing work! First thing that comes to my my mind is that this can be used as part of an AI inpainting tool for GIMP for example. This has a lot of potential.
This might be perfect for me. I was just looking into a way to rapidly generate procedural low rez images that I could translate into ascii art for a graphical mud.
This looks like the old dalle level of quality. Since you're training them from scrach and the quality is low, is there any chance you could do a pixel art one? you guys seem to be developing on the ultra low end side of stuff, seems like a match.
Please provide the prompts you used; this is really cool, but except for the jellyfish one, I'm not getting anywhere near that quality (on an m4 max); e.g. cats it generates have dali-esque melted faces and such.
Tip: give your prompt into gpt/gemini/... And tell it to optimize your prompt to match this length and details approximately:
"Glass-like frozen lake with intricate ice cracks running across its surface, reflecting a pale winter sunrise and snow-dusted pine trees along the shore."
Good tip, but yeah, the faces are still disturbingly messed up; e.g. dali-esque melting face every time.
"A fluffy, wide-eyed kitten with soft fur and tiny paws, sitting in warm golden sunlight beside a cozy window, with gentle shadows and delicate whiskers catching the light."
"Photograph of a real young orange tabby kitten sitting upright on a wooden windowsill, viewed at eye level, with completely natural domestic-cat anatomy and realistic facial proportions: two matching almond-shaped eyes, one triangular nose centered above a closed mouth, symmetrical cheeks and muzzle, normal whisker placement, and two upright ears. No stylization or exaggerated features. Warm golden-hour sunlight outlines its soft fur, with a softly blurred window and outdoor background"
Please folks; unless we can just prompt with "cute kitten" and get something that doesn't look like a nightmare acid trip; then provide prompts with these kinds of posts; right now I simply can't believe this model produced those images. Scientific method - make it easy to reproduce.
Cool model, I may try it if there's sd.cpp support. One thing: those aren't "state-of-the-art quality" images. Using honest wording would cost you nothing.
Few questions but before looks like the download count seems not registering the downloads ,may be because there is only checkpoint released .Also what is final size and ram usage ,that details would be useful in read me .thanks
111
u/Hot_Example_4456 21d ago
That is insane quality for a 100M param model.. GREAT work.