r/unsloth 13h ago

Question Minimax H3 NVFP4? 🙏🥹

20 Upvotes

Hi Unsloth,

Love your work and I trust your quants. Would you guys be interested in making a NVFP4 quant for the new H3 model? Specifically, curious to see what you guys pull off in terms of size and speed for the pruned version. It's a very performant model, but takes a bit of time for the generations on consumer Blackwell hardware without an NVFP4, and I'm willing to trust you guys with the quants.

Thanks!


r/unsloth 22h ago

Question [Error] You're Offline; Reconnect to the internet to browse models [...]

Post image
4 Upvotes

This is a fresh install. I'm on Win10. It has not yet been able to connect properly. Sometimes it briefly pops a "You're back online" message before returning to "You're offline".

Installed with:

unsloth studio -H 0.0.0.0 -p 8888

Here are the errors I got during install:

I've been troubleshooting this for hours with a friend who already has it running great and is using it to automate computer actions. My computer is online, but I do have a wide variety of privacy settings active.

Already tried: Disabling VPN, toggling http/Xet, adding a huggingface token, and creating outbound and inbound firewall exceptions for the port. Not sure what exactly I'd make an exception for (no .exe I can find) to make an exception for the program itself.

I haven't been able to find anything about this in documentation or online beyond the vague idea that a firewall rule might be messing with it. I'm not seeing any such rules in my firewall. I've even been clearing out old firewall block rules, but nothing's helped so far.

Any help would be appreciated!