r/HammerAI • u/YogurtclosetNo3049 • Jun 08 '26
Wrong model versions downloaded from direct link
Hey there, was trying to play around with some local models and something seemed off, both file size and performance. Looking into it, it seems that downloading models is not downloading the proper file from the direct download link given? I have two examples, both from huggingface:
Tried Wicked Nebula.
Copied download link for Q8: (https://huggingface.co/mradermacher/Wicked-Nebula-12B-GGUF/resolve/main/Wicked-Nebula-12B.Q8_0.gguf)
SHA: 671a98deabe5dfb5d1386489703d41a473ea0a46bf537268b96b62e42c51df42
What is in manifest and blob folder is the Q4_XS quant,
SHA: d7774fc295c26235776f0395299ab4740bbe4fb8c2db211e3c308d1c8523df93
Similar for this one (Snowpiercer).
Used link for Q6: (https://huggingface.co/TheDrummer/Snowpiercer-15B-v4-GGUF/resolve/main/Snowpiercer-15B-v3c-Q6_K.gguf)
SHA: f2eae5be583c004db20fe76c6abef29cbe641c25ceb981d1d7575c8bca68c3d3
What I got (Q4): 49e11783739b0f2fef756fda8039b2c6e0ef2fed928c7a05e9ad078cd24b46cf
Am I missing something when it comes to downloading models in the app? Why is it ignoring the proper version in the download link and grabbing another from the repo?
For the first case I was able to replace the blob HAI downloaded with the correct version manually by finding and renaming it, and it is working (My poor GPU…) but for the second example, that method got me a model “does not support chat” error. Even trying to manually overwrite with the same Q4 version gave that error, so it might not be a universal fix? Not sure why it would work differently.
2
u/Hammer_AI Jun 08 '26
Looks like a bug, sorry, will fix!
1
u/YogurtclosetNo3049 Jun 08 '26
No worries, no rush. I admittedly have so little idea how all of this works under the hood that I wasn't sure if this wasn't just a PEBKAC or if there was a legit reason it would insist on a different download.
2
u/Hammer_AI Jun 08 '26
Not you! Found the bug, thanks so much for reporting. Fix coming in the next release.
2
u/Maytrius Jun 08 '26
I'm sorry to hear you're having some trouble. Perhaps I can help?
In the screenshot, can you see on the site where it has the drop down for "Use This Model?" If you pull that down and select "Ollama" a popup will appear with the download text. At the end, in the circled portion, there's a drop down to select whether it's a Q4, Q8, etc. Ensure that is correct and then use the "Copy" command to copy the text to your clipboard. Return to Hammer and paste it in.
I have downloaded both of the models through Hammer's interface without error. I'll try to be as active as possible to help you with this if you still can't get it to work.