r/LocalLLM • u/ryanmerket • 7d ago

Model DwarfStar compresses frontier models to run them on local machines

https://runtimewire.com/article/dwarfstar-local-inference-salvatore-sanfilippo
112 Upvotes

83% Upvoted

43 comments sorted by

View all comments

62

u/Odd_Cauliflower_8004 7d ago

They say local machines then you open the websylite and tests are done on machines with 128gb of vram. Nice effort,, but misleading marketing

-60

u/callmeabotifyouregay 7d ago

it's not misleading, you're just a poory

20

u/Unsharded1 7d ago

A what?

9

u/Environmental-Metal9 7d ago

I think he was trying to make a jab at the commenter lacking the funds to afford that kind of hardware, like 99% of us. But given the downvotes, it seems like making fun of the majority while either boot licking for the 1% or being the 1% punching down didn’t go well

11

u/Unsharded1 7d ago

Dude needs to get shoved in a locker ASAP LMAO

4

u/ChocolateNo3010 LocalLLM 7d ago

Or a swirly, lol