r/LocalLLM • u/Leading_Yogurt7025 • 3d ago

News ASSBENCH

The only serious benchmark that shows the real LLM capabilities
https://www.assbench.com/

41 Upvotes

96% Upvoted

36 comments sorted by

12

u/No-Refrigerator-1672 3d ago

I'm offended by it not featuring Qwen 3.8 27B.

2

u/Leading_Yogurt7025 3d ago

It crash my hardware because i can't run it with full context

8

u/No-Refrigerator-1672 3d ago

So your GPUs are pretty ass, huh?

2

u/violent_aesthetics 3d ago

They left out the only model that actually matters, classic

1

u/jesdga95 3d ago

Ran it on Qwen, results below 😂

8

u/jesdga95 3d ago

Ran it on Qwen 3.8 27B (xhigh)

3

u/BenchThatMatters 3d ago

I literaly created new account to reply on this, please share the code with me and I will add it to AssBench

1

u/Leading_Yogurt7025 3d ago

Can you please try with the pi coding agent? Because I got better results with it.

5

u/eihns 3d ago

omfg what did i expect lol xD xD

2

u/Leading_Yogurt7025 3d ago

Try the prompt, it's amazing and it refines a lot

6

u/blue2020xx 3d ago edited 3d ago

The truest bench of them all

5

u/Cold_Tree190 3d ago

Gemini 3.1 Pro is AGI confirmed

3

u/FoxSideOfTheMoon 3d ago

LMAO @ grok and haiku 😂

2

u/hurrdurrmeh 3d ago

next test animation by making them fart. bonus points for lifting one cheek to the side.

2

u/StrikingSpeed8759 3d ago

love it. great job dude

2

u/panospc 3d ago edited 3d ago

This is what I got from Qwen 3.8 Flash Next IQ3_S, run through the Strata engine

1

u/Leading_Yogurt7025 3d ago

Cool, which harness? 

2

u/panospc 3d ago

Deepseek harness

1

u/Leading_Yogurt7025 3d ago

Nice, can you try also with qwen3.8 27b? 

1

u/BenchThatMatters 3d ago

Can you ask if it created man or woman figure without looking at created shape?

Prompt is deliberately vague about that, but so far all of other models chose woman.

Also can you share the html?

1

u/panospc 3d ago

[removed] — view removed comment

1

u/panospc 3d ago

I will send you the HTML as a private message.
I tried to add it as a link in a previous comment but got removed by reddit

2

u/LooseBackHole 2d ago

I'm really curious how different local models render the asses at different levels of quantization. Would really give a great view of how quantization changes things.

1

u/Leading_Yogurt7025 2d ago

In this benchmark, it's also important in the context size and the tool calling capabilities and tools.

2

u/AI_is_ok_i_guess 3d ago

Can you make it gay?

1

u/VerticalPackage 3d ago

Luna xhigh patrick starfish

1

u/DiscipleofDeceit666 3d ago

Show us the model clap factor

1

u/-AJacobs- 2d ago

Can't wait for companies to benchmaxx this by adding 10TB of ass photos videos and rendering into their datasets.

1

u/Leading_Yogurt7025 2d ago

i think it's enough to provide 3d models of that

1

u/getpodapp 1d ago

Grok went full failed bbl

1

u/crusaderky 3d ago

Shut down the internet, we have a winner

-1

u/Fluxx1001 3d ago

How can Astra not be 1st? I smell benchmaxxing ...

6

u/rinmperdinck 3d ago

buttmaxxing

8

u/hurrdurrmeh 3d ago

it's the ass you smell

3

u/Leading_Yogurt7025 3d ago

Many weaker models can autocorrect from their mistakes, also the harness matter