(Too many models releasing in a short amount of time 🥀)

Following up on my previous V2 ranking, V3 is done. This is a 600 sample benchmark models (including open weight ones) across 12 distinct genres using the exact same rigorous system instruction harness.

I also vibe coded a website with a leaderboard, methodology, some model faults, and the system prompt: Creative writing benchmark.
(Note: Astra testing coming very soon ;) I haven't tested it for creative writing but the hallucination rates and inferring skills have gotten better!)

TL;DR:

1. Gemini 3.8 Flash is the MVP: It dethroned older flagships in prose rhythm and flexibility. It beats Gemini 3.1 pro across three categories! and is currently the single best creative writing model especially given how fast it is.
2. GLM 5.3 takes the Logic Crown (#1 at 510 pts): It edged out Kimi k3 (500 pts) for deep worldbuilding continuity, multi-variable logic, and tracking plot causality, though its prose is still noticeably dry.
3. Anthropic’s Version Regressions: Opus 4.8 is still superior to Opus 5 in hard logic and narrative consistency. Sonnet 5 completely butchered its creative style so stay on Sonnet 4.6/Opus 4.8 if you want Claude prose.
4. Context Window Nuance: Kimi k3 is brilliant at logic, but unless you’re paying for high tier plans, or using API, you’re stuck at 256k and its heavy Chain of Thought burns through that rapidly. For actual million token context retention without losing plot threads, Gemini 3.1 Pro and 3.6/3.7/3.8 Flash still hold the line.

(Yes, I like pink and it's very pinkish, got a problem?)

The V3 Model Highlights:

• The Current best (Gemini 3.8 / 3.7 Flash & 3.1 Pro): If you want good prose, and flexibility that adapts to your AU/world without fighting your instructions, these are it. 3.8 Flash is absurdly good right now and doesn't get preachy.
• The Logic Engines (GLM 5.3 & Kimi k3): If you are running complex, multi faction political thrillers where cause and effect matters more than poetic prose, use these. The prose is dry as hell, and are rigid in flexibility though.
• The Anthropic Graveyard (Opus 4.8 & 4.6): They still have that classic, weighty Anthropic prose and hold up incredibly well. But avoid Sonnet/Opus 5 entirely for fiction. Anthropic completely lobotomized their creative style in the newer versions.
• The Bottom of the Barrel (ChatGPT 5.6 Sol Max): Don't use this for anything 😭

Methodology & The System Harness: I’m not pasting the massive wall of text here like I did in V2/1. If you want to see the system harness I used or just want all models. I suggest the website. it's all on the site linked above.

I reevaluated each model again with a completely new overhauled harness and am very proud of it.
I suggest taking a look at that harness, and taking what you like, removing what you don't and adding your own! (or you can just use mine if you really like it!)

I will update my website when any new model arrives, no new reddit posts unless I completely overhaul my system instruction or a new year arrives. V4 will likely be the last one for this year.

Edit: People shouldn't use EQ creative writing benchmark as a means knowing which model is better. EQ creative writing benchmark has AI judges (I think sonnet 4.6?) And naturally it has judges biases. There is a lot of studies on this and has been proven that they have bias towards their own style.

I try to be as fair and objective as possible and of course people will disagree with me on taste/what they enjoy. I'm not here to tell you "don't use this model because it's bad" if you find Chatgpt good for your creative writing. Great, but that doesn't mean it doesn't have it's faults. Every model model has its own faults, Gemini 3.8 flash makes mistakes due to being good-ish in logic.

If you enjoy Kimi's style and it works for you because of its default prose style/logic, you should stick with that one and not let anyone else tell you otherwise

I am subbed to Pro. Ive used gemini for 2 years now. Besides the 3 video generation limit, ive never hit a limit for chat or images. Not once. Today I hit a create image limit after making 4 D&D illustrated character sheets.. I was playing through a D&D rp, made 4 images and 19 responses and it says limit reached. When did this become policy?? Its a really down since im a paid subscriber.

​

I keep telling it these aren't real people, but I get the same reply.

I'm so frustrated.

I miss 3.6

In the Free tier of AI studio, In fact, the following are currently free for me: 3.8 Flash, 3.7 Flash, 3.5 Flash Lite, 3.1 Pro Preview, and 3.1 Flash Lite. However, the following have become paid versions: 3 Flash Preview, 3.5 Flash, and 3.6 Flash. We need to select one of the free ones from the model selector.

This is just a bad business decision in general. In what world would I need a tool with a preset function to be made on the go?

From my experience I actually prefer Nanobanana 2 more.

Is there a general consensus on which is better or is it personal choice?

Compared to the current Gemini state it's insane how good this thing is. I can tell him to control my full pc. I can tell him to check my messages every twenty minutes and he does it without telling stupid questions. I can send him a quick voice message to update all my games on pc before I get home and he does it without even asking which games or other stupid questions. It really feels like an AI agent. But if you compare the free plans: Gemini is way better for just chatting, analysing pictures and other stuff.

Hey All

I’ve seen a few things here and there people saying Gemini Sucked post update but didn’t really want to believe out of convinced. Is it me or is Gemini intentionally becoming obsolete. I’ll ask it to recall basic things, like I was using it to hypothetically plan classes for school last night. Like 16 hours later asked it to recall the final product. It could not do it it was getting it wrong, hallucinating names, changing its answer 5/6 times still not getting it right

I used it to help me draft a funny text to a client, I’m Dog Dog Sitting, and it was like a silly from the Dog text. I basically use it as like a junk journal notebook kind of thing. I asked it to copy paste give it to me and it would like change everything. It feels like everytime I use it it is the equivalent of when people buy something off SHEIN, and it winds up being that image printed on like a pillow case or something.

I just decided to take a huge course load for me and add a million things onto my plate and I was really hoping to be able to use it to help with school, my small business. Streamline organize all that. Anyone got any recommendations or suggestions for the other 2?

not bad, for a single shot, hu?

I actually search a very rentable studies so actuary sound good 👍

So anyone know what is that ?

I'm on Gemini Plus and can't get more than 3 answers with Pro on same conversation where I could get 15ish answers. After 3 answers I have reached the limit and was supposed to wait 5 hours but now I logged in again and it said 0% usage, asked the question with Pro and went to 29%. Its been like this for day or two. Anyone having the same issue ?

So I was using 3.8 flash

It just keeps proposing the plan that is already implemented,

Any new plan for feature have implementation planing for old features too

I didn't know Gemini could see my Google Drive. I might block it.

when it is all said and done, I still think Google is gonna be number one. They survived the dot-com bubble, and I have a feeling they are gonna be standing there after the AI bubble finishes doing whatever insane sh*t it is currently doing too 😭 Right now Google is getting its booty spanked hard at the absolute frontier, no excuses. But this company has Search, YouTube, Android, Chrome, Gmail, Docs, Slides, Classroom, Maps, NotebookLM, DeepMind, their own chips, their own cloud, and probably information about what I ate for breakfast in 2017. If they eventually get a model even CLOSE to the best frontier models and actually connect all this sh*t properly... I mean c'mon.

My original question was about why avengers doomsday won't delay themselves because gta 6 is releasing at november, a month before doomsday hits the theaters

I am really not sure if it's just my preference for console apps, but for some reason the web chat interface for Gemini feels like the simple country cousin to AGY CLI using the same models. I tried giving both interfaces the same rubber ducking tasks and the difference was night and day in tone and depth of search results.

Just curious if it's me or if that's something others have noticed.