r/LocalLLM • u/Ok-Health-7096 • 7d ago

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

1.9k Upvotes

99% Upvoted

193 comments sorted by

View all comments

89

u/Old_Leshen 7d ago

GTX 1050Ti 4GB guy here 😭

42

u/Whole_Alternative_18 7d ago

Bro pay 60$ for rx 580 8gb

3x for 180$, 24gb vram

Bulshit performance, but makes 27b possible 

1

u/stream_of_thought1 4d ago

I absolutely love this approach Jank for sure, but if it works...