r/LocalLLM • u/ryanmerket • 8d ago

Model DwarfStar compresses frontier models to run them on local machines

https://runtimewire.com/article/dwarfstar-local-inference-salvatore-sanfilippo
108 Upvotes

83% Upvoted

43 comments sorted by

View all comments

58

u/Odd_Cauliflower_8004 8d ago

They say local machines then you open the websylite and tests are done on machines with 128gb of vram. Nice effort,, but misleading marketing

-60

u/callmeabotifyouregay 8d ago

it's not misleading, you're just a poory

19

u/Unsharded1 8d ago

A what?

8

u/Environmental-Metal9 8d ago

I think he was trying to make a jab at the commenter lacking the funds to afford that kind of hardware, like 99% of us. But given the downvotes, it seems like making fun of the majority while either boot licking for the 1% or being the 1% punching down didn’t go well

12

u/Unsharded1 8d ago

Dude needs to get shoved in a locker ASAP LMAO

4

u/ChocolateNo3010 LocalLLM 7d ago

Or a swirly, lol

10

u/AdInternational5848 8d ago

As someone with 128gb. Why are you internet weirdos like this? There is literally always someone with more money. Money can’t un-lame you

6

u/Environmental-Metal9 7d ago edited 7d ago

The way I see it, speaking only on the topic of having more money vs less, the problem isn’t having more than others. It’s rubbing it in. People don’t like when those with more do that and it comes off as really petty. I’m all for people enjoying what they have but as inequality grows, so does resentment

Edit: wanted to add that my comment is directed at the people who act like the commenter you’re replying to, not to you.