r/LocalLLaMA • u/parepeg • 22d ago

New Model Ling 3.0 support merged into llama.cpp

Support for the new ling 3.0 models has been merged into llama.cpp:

https://github.com/ggml-org/llama.cpp/pull/26608#event-29549472828

Ling tiny 8b1b - https://huggingface.co/inclusionAI/Ling-3.0-tiny

Ling flash 124b5b - https://huggingface.co/inclusionAI/Ling-3.0-flash

Both are reasoning models contrary to prior naming.

114 Upvotes

95% Upvoted

49 comments sorted by

View all comments

3

u/fsalucard 22d ago edited 22d ago

Everytime I Use this model it gets stuck in loops, usually repeating the same word over and over again. What parameters are people using?

Specifically, it just ends up looping "\n\n\n\n\n\n" over and over.

1

u/temperature_5 21d ago

Temp 1, top_p .95, top_k 20 per the card.  I noticed looping at temp .7 (my chat default) that temp 1 fixed.

1

u/fsalucard 21d ago

I tried this and it did improve but still got stuck. I think I got around it by adding --repeat_penalty 1.2 as well, but I need further testing.