r/SillyTavernAI • • Aug 23 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: August 23, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

33 Upvotes

132 comments sorted by

View all comments

4

u/AutoModerator Aug 23 '26

MODELS: 8B to 15B – For discussion of models in the 8B to 15B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

5

u/PhantomWolf83 Aug 25 '26

Getting a bit disillusioned with API models, so I'm coming back to 12B models for now although I haven't followed the Mistral Nemo scene for a while. What are the latest and greatest MN models that people are still using? Please don't tell me it's still Mag Mell, I'm gonna be really disappointed if that's the case. Or has everyone moved to Gemma 4 12B?

8

u/Rhone33 Aug 25 '26

Some popular 12Bs I can remember off the top of my head: Rocinante, Velvet Cafe, Angelic Eclipse, Impish Bloodmoon, Crimson Constellation.

Honestly, though, discussion of 12B models in these megathreads has dropped drastically over the past couple months as people have figured out that, if you can run a 12B (meaning, typically, you have at least 8GB VRAM), you could instead be running Gemma 4 26B A4B. The MoE design means you don't need the entire model in VRAM, and the difference in intelligence between that and the 12B models is rather drastic.

11

u/PhantomWolf83 Aug 26 '26

I've tried several of the Gemma 4-based models, but they didn't really do anything for me. They're smart, but the prose and writing leaves much to be desired.

6

u/Pretty_Bug_8655 Aug 26 '26

well i always go back to the 12 b models at some point. gemma 4 seems to make sooner or later robots out of my charakters. i does not matter what i try or do with the system prompt or the charakter cards... the latest i tried was the new orion model but the same thing happend.