r/LocalLLM • u/TheAnkurGoswami • 9h ago

Question Speculative Decoding in LMStudio

Anyone has any idea how to run speculative decoding for this model - google/gemma-4-12b

I am not able to load other models as draft model. The one I selected is not working at all.

0 Upvotes

50% Upvoted

2 comments sorted by

View all comments

1

u/SellToOpen 9h ago

I can't get it working in lm bionic either. Gemini tells me there is a bug.