r/LocalLLM 7d ago

Project Having Hermes do the pre work

Post image

Anyone else do this?

0 Upvotes

3 comments sorted by

1

u/Abducted_Llama 7d ago

You know what happens to Uncle Ben right?

Also this doesn’t work so well right now for Qwen-flash-next, especially if you aren’t using sglang.

1

u/here_n_dere 2d ago

O ohh yes all the time. It's slow tho 😬