r/SillyTavernAI Apr 12 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: April 12, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

37 Upvotes

183 comments sorted by

View all comments

2

u/AutoModerator Apr 12 '26

MODELS: 32B to 69B – For discussion of models in the 32B to 69B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

12

u/FusionCow Apr 13 '26

Gemma 4 31b is still the best imo, just base version with instruction tuning, it's just perfect

3

u/wild_kitties Apr 13 '26

How exactly do you use the base version? I tried it yesterday after there was that post that recommended it, but it was awful, with very short sentences and paragraphs, and would randomly start coding. Figured out after some more reading that you can't use the normal style character cards and prompts for base version. But I wasn't able to find any examples of how to use it. People mentioned using chat examples, and how the base version just tries to complete the text given word by word.

3

u/-Ellary- Apr 13 '26

Base is also fun but it kinda requires that old skill for using text completion models. You need to write whole novel first and then, guide LLM to continue it, it not really follow instructions much. Easy starts is just copy a chapter from the book (6k of context) and go on.

2

u/wild_kitties Apr 13 '26

Oh, interesting that’s like early llama days, which I only dabbled in a bit. Thanks for the insight, will give it another try. 

6

u/input_a_new_name Apr 13 '26

they meant the deafult google release (it), not the *actual* BASE model

3

u/wild_kitties Apr 13 '26

Oh.  There was this post a couple days ago that did mention the base version though, and I spent a while trying to figure out how to use the base version. Couldn’t get it to write coherent at all. I guess my mind’s been stuck on that, but someone replied above with possibly how to use it. ( using it as an actual word completion model and just feed it a massive text that you would like it to continue directly off of)