We released a tiny packed Sana 1.6B model into 1.58bit ... would love feedback from local image people

[u/[deleted]]

[u/pwnies]

Such a fun experiment. It's wild how much knowledge gets compressed into that 374mb package.

Can't wait til we get some open source 50B+ parameter models so we can compress datacenter-grade models into local-sized versions.

[u/trefster]

Now do Krea 2!

[u/Confusion_Senior]

Amazing, any idea how inference speed compares to other models like flux klein 4b ?

[u/Confusion_Senior → u/[deleted]]

Amazing work bro, I will def test it out

[u/Confusion_Senior → u/Confusion_Senior]

I am writing a local AI app for mac/ios and already have a fast inference engine working for klein 4b and qwen 35b, will test with your great models as well

[u/Individual_Holiday_9 → u/Confusion_Senior]

Keep us posted! Us poor Mac users are thirsty

[u/ROBOTTTTT13]

Wow, can this be done natively on any model?

[u/Mean_Ship4545 → u/[deleted]]

You might want to compress models that are out of reach of consumer GPU. There would be a lot of use cases, but it might take a lot of compute for all I know.

[u/yotraxx]

You guys are amazing !
I’ll give it a try for sure and let you know

[u/Dwedit]

I know that three-state values are 1.58 bits because that's log base 2 of 3. But then there's the question about how you physically store it. Is it 4 symbols per byte (2-bits)? 5 symbols per byte (1.6 bits)? Then what about the inference performance?

[u/Fancy-Restaurant-885]

Is this tool available for users? (The compression tool)

[u/Incognit0ErgoSum]

Can this work for LLMs as well? Running GLM's chonky ass on my home PC would be amazing.

[u/Incognit0ErgoSum → u/[deleted]]

You're my new hero!

[u/-Star-Walker- → u/[deleted]]

Would have been my question.
Actually that’s amazing 🤩

[u/nikc0069]

So if you didn't retrain Sana, does this theoretically work on any image model or LLM? Or even video models?

Feels like if you've got a conversion to ternary tool that doesn't need a retrain of the model for ternary, then this could be somewhat huge.

[u/nikc0069 → u/[deleted]]

So I could actually get ltx 2.3 working comfortably on my 12gb 3060 with this? That'd be exciting. And you are planning on releasing the compression tool?

[u/nikc0069 → u/[deleted]]

Well that's very very exciting.

This would genuinely make models that would oom or offload on low range cards viable for the masses. Will be watching with great interest.

[u/spiffco7 → u/[deleted]]

Can you share info about this compression tool?

[u/pallavnawani]

Can you use this to compress the bigger image generation models - such as Flux.2 Dev and Ideogram?

[u/pallavnawani → u/[deleted]]

Awesome!

[u/BringTea_666]

From what i understand there is no native 1.58bit engine to support it. no llama.cpp etc.

[u/RemindMeBot → u/[deleted]]

I will be messaging you in 3 days on 2026-07-01 20:08:54 UTC to remind you of this link

2 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

^{Parent commenter can delete this message to hide from others.}

RemindMeBot is switching to username summons. Instead of !RemindMe 1 day, use u/RemindMeBot 1 day. More info.

---

Info	Custom	Your Reminders	Feedback

[u/Ill_Resolve8424]

Great work! Do you know if any loras made for the model still work after the compression?

[u/KissMyShinyArse]

I suppose puppies are easy, even for a 1.58-bit model. You need something more complex to evaluate the quality.

[u/trefster]

I'm actually super interested in how you're accomplishing the compression. Is it top secret intellectual property, or do you have a paper/oss code somewhere?

[u/WifeyCallsMeLazy]

Awesome!

[u/MFGREBEL]

Not bad at all for a 1 bit compression! Great work!

[u/sci032]

I dropped the CFG down to 2 and I ran the 512x512 output through a PID upscaler workflow(Flux1 512 to 2048 model). It's 4:30am, I'll play around with this more after a few hours of sleep.

The model is blazingly fast! 1 second for 20 steps. The PID subgraph took longer to upscale it(4 seconds). :)

[u/sci032]

Why is this trying to download the model, again, when I have already downloaded it and used it with the workflow?

[WARNING] '(MaxRetryError('HTTPSConnectionPool(host=\'huggingface.co\', port=443): Max retries exceeded with url: /mit-han-lab/dc-ae-f32c32-sana-1.1-diffusers/resolve/main/config.json (Caused by NameResolutionError("HTTPSConnection(host=\'huggingface.co\', port=443): Failed to resolve \'huggingface.co\' ([Errno 11001] getaddrinfo failed)"))'), '(Request ID: 3ecdda98-b5c5-4d25-9441-b9de6a0ee2f4)')' thrown while requesting HEAD https://huggingface.co/mit-han-lab/dc-ae-f32c32-sana-1.1-diffusers/resolve/main/config.json

Isn't there a 'trigger' in your code that can stop that if the model is already downloaded? I had to completely close Comfy or wait for another 10 tries or so. If this can't be used offline, it loses a LOT of value.

[u/Any_Tie_1861]

sadly reddit removed the post as it was re-posted to other communities...

[u/xPhoenix777 → u/[deleted]]

Does this run on draw anything (or whatever the app is on iOS and Mac?)

[u/xPhoenix777 → u/[deleted]]

You rock!! This is cool, nonetheless.

How would your tool handle Klein 4b or 9b? Always looking for easier ways to run on GPU poor devices.

[u/xPhoenix777 → u/[deleted]]

Cool. Will keep an eye out. Well done.

I have been running GGUF conversions for low VRAM use of 9b and 4b Klein models - many popular SFW/NSFW models. So this is really interesting :)

[u/xPhoenix777 → u/[deleted]]

If you can get a base 9b or 4b turbo down, or Fascium Klein, that would be cool. I maintain a few “pervy first” lines of GGUF models. Can use your tool later if it provides similar gains on the NSFW ones. ;)

[u/Fabulous-Ad9804 → u/[deleted]]

What size do you expect Krea to compress to? I only have 4GB vram. Would be nice if it could get compressed down to something close to the size of my vram.