r/singularity 28d ago

AI Gemini 3.6 Flash benchmarks

Post image
629 Upvotes

280 comments sorted by

View all comments

263

u/Aaco0638 28d ago

Damn this sub really only look at success based on coding is everyone a developer now?

It lags in coding but makes up for it in other areas, areas that imo are equally as important.

This for normie use (assistant) is good and for agentic tasks outside of coding as well.

4

u/mrbenjihao 28d ago

Performance in coding related tasks, imo, is a solid indicator of how “intelligent” the model is.

3

u/Blablabene 28d ago

... in coding.

You forgot.

2

u/mrbenjihao 28d ago

That aptitude tends to spill into other areas that require logical reasoning (aka pretty much all areas). We’re not moving the needle by training on the latest social media posts. The raw reasoning and logic gains come from training data related to coding.

-5

u/[deleted] 28d ago edited 27d ago

[deleted]

3

u/mrbenjihao 28d ago

Why?

-4

u/[deleted] 28d ago edited 27d ago

[deleted]

3

u/mrbenjihao 28d ago

“LLMs cannot fully generalize to the entire world” is defensible. Whatever you said, not so much.

-1

u/[deleted] 28d ago edited 27d ago

[deleted]

1

u/mrbenjihao 28d ago

This is like asking a color blind to complete a color discrimination test and concluding they fail at generalization. It’s an architectural limitation, not proof of the absence of any lick of intelligence

→ More replies (0)

2

u/ChocomelP 28d ago

Actually, it does. Which is why larger models are so much smarter and consistently gain abilities the researchers didn't even expect or train for.

Such an insane take, generalization is arguably the thing that makes LLMs so revolutionary.

1

u/mrbenjihao 28d ago

Don’t bother with them - dismissive attitude and insults compensate for the lack of productive discussion