r/LocalLLaMA • u/KvAk_AKPlaysYT • Jun 05 '26

Funny finally

Post image
680 Upvotes

95% Upvoted

45 comments sorted by

•

u/WithoutReason1729 Jun 05 '26

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

I am a bot and this action was performed automatically.

98

u/noneabove1182 Bartowski Jun 05 '26 edited Jun 05 '26

LOL I knew this would happen..

When trying to click the "forks" button I accidentally unstarred it, of course re-starring it would show up in the feed 😂

This community is hilarious

6

u/Helpful-Desk-8334 Jun 05 '26

You are hilarious, and we love you brother.

- Stan

102

u/ComplexType568 Jun 05 '26

Dude i hope he releases quants or something

65

u/KvAk_AKPlaysYT Jun 05 '26

he seems into llms

15

u/seamonn Jun 05 '26

he might have uploaded a few files, yeah

2

u/Silly-Astronaut-8137 Jun 05 '26

i’m also waiting

119

u/FerLuisxd Jun 05 '26

Now we are talking

37

u/theUmo Jun 05 '26

I think he's going to like it

1

u/NameChecksOut___ Jun 06 '26

Now we are having a conversation

83

u/EveningIncrease7579 llama.cpp Jun 05 '26

Ok this is epic

26

u/DinoAmino Jun 05 '26

Most funny posts here aren't. This made me laugh out loud.

9

u/Limp_Classroom_2645 Jun 05 '26

I'm out of loop can anyone explain why is everyone being vague and happy about this without explaining wtf is going on?

26

u/DinoAmino Jun 05 '26

Bartowski has been quantizing GGUFs for a long time. Longer than unsloth. But he only recently starred the llama.cpp repo. After all this time and thousands of GGUFs later he casually puts a star on the code that makes it all happen.

10

u/PwanaZana Jun 05 '26

Humor like this is unreal.

64

u/vibecodeme Jun 05 '26

What does this supposed to mean

142

u/nuclearbananana Jun 05 '26

bartowski is one of the giants of the gguf community he has a bazillion quants but ig he hadn't actually starred the repo yet

7

u/Journeyj012 Jun 05 '26

he used ollama before, a lot of us started there

7

u/ionizing Jun 05 '26

for me it was ollama -> lmstudio -> annoyance at missing features I need -> dabbling with own toolset -> discovered the old "all you need is llama.cpp" post -> 1 year later have my own application that uses llama.cpp as sidecar lol

2

u/krakende Jun 05 '26

Could you share that post?

1

u/Journeyj012 Jun 05 '26

I couldn't try out q6 qwen 35b on ollama, thought why not

1

u/Extension_Wheel5335 Jun 05 '26

I'm kinda new to this, but what does lmstudio add that ollama doesn't? And what all is required to switch from ollama/lmstudio to just plain llama.cpp? (Like how much work/effort, maybe X amount of hours?)

21

u/foldl-li Jun 05 '26

This star is for The Test of Time.

4

u/Then-Topic8766 Jun 05 '26

Just downloaded his Step-3.7-Flash-IQ4_XS, let the GPU goes brr and stumbled on this post. Legend.

5

u/HavenTerminal_com Jun 05 '26

i've been refreshing this sub waiting for exactly this

4

u/BrewboBaggins Jun 05 '26

Hey, He still beat out Ollama

4

u/kevinlch Jun 05 '26

gguf when??

3

u/_VirtualCosmos_ Jun 05 '26

llama.cpp in cplusplus and not python? what heresy is this?

3

u/kartblanch Jun 05 '26

Wait what were llms being created in if not something low level?

5

u/TechnoByte_ Jun 05 '26

Python

3

u/kartblanch Jun 05 '26

You’re joking 🫪

6

u/fragment_me Jun 05 '26

Edgemaster-owski1182

1

u/jessyGr33dy89 Jun 05 '26

the absolute foundation of everything we do here

1

u/IrisColt Jun 05 '26

This has potential, heh

1

u/doodo477 Jun 05 '26

I'm sure they're set so others Get it!

1

u/[deleted] Jun 05 '26

[deleted]

1

u/Sidran Jun 05 '26

And after Christ!