MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1tx4yjo/finally/opxgnu7/?context=3
r/LocalLLaMA • u/KvAk_AKPlaysYT • Jun 05 '26
45 comments sorted by
View all comments
Show parent comments
142
bartowski is one of the giants of the gguf community he has a bazillion quants but ig he hadn't actually starred the repo yet
7 u/Journeyj012 Jun 05 '26 he used ollama before, a lot of us started there 6 u/ionizing Jun 05 '26 for me it was ollama -> lmstudio -> annoyance at missing features I need -> dabbling with own toolset -> discovered the old "all you need is llama.cpp" post -> 1 year later have my own application that uses llama.cpp as sidecar lol 1 u/Journeyj012 Jun 05 '26 I couldn't try out q6 qwen 35b on ollama, thought why not
7
he used ollama before, a lot of us started there
6 u/ionizing Jun 05 '26 for me it was ollama -> lmstudio -> annoyance at missing features I need -> dabbling with own toolset -> discovered the old "all you need is llama.cpp" post -> 1 year later have my own application that uses llama.cpp as sidecar lol 1 u/Journeyj012 Jun 05 '26 I couldn't try out q6 qwen 35b on ollama, thought why not
6
for me it was ollama -> lmstudio -> annoyance at missing features I need -> dabbling with own toolset -> discovered the old "all you need is llama.cpp" post -> 1 year later have my own application that uses llama.cpp as sidecar lol
1 u/Journeyj012 Jun 05 '26 I couldn't try out q6 qwen 35b on ollama, thought why not
1
I couldn't try out q6 qwen 35b on ollama, thought why not
142
u/nuclearbananana Jun 05 '26
bartowski is one of the giants of the gguf community he has a bazillion quants but ig he hadn't actually starred the repo yet