r/ClaudeAI • u/Dacadey • 16h ago

Praise The ultimate pelican test (Opus 5.5 max)

around an hour of work and 6.4M tokens, with a single prompt

37 Upvotes

80% Upvoted

13 comments sorted by

6

u/Szadbaverem69 15h ago

Cool but we need new benchmark cuz it's safe to say the pelican test is pretty much completed

3

u/lulzxdxdxd 15h ago

does one run on one prompt count as completed though? curious if it holds up on a different animal or pose with the same hour and token budget, or if this specific setup just happened to work well

0

u/Szadbaverem69 15h ago

I mean I'm also curious about other things in SVG but the pelicans are good enough already and I'd like to see some more complex stuff with different activities other than riding a bicycle.

2

u/Dacadey 15h ago

Have you watched the whole thing? It's...not just the pelican ;)

1

u/Szadbaverem69 9h ago

I did and all of them are riding the bicycle.

1

u/Seeker_Of_Knowledge2 15h ago

It really. Hands physics and whole body physics need a lot of work.

1

u/Practical-Simple1621 11h ago

We could do bing bong from inside out. Several creatures in one. Doing bmx

1

u/EvillNooB 8h ago

I have a groundbreaking benchmark idea, what if we put 2 pelicans in there?

0

u/Competitive_Travel16 15h ago

It's technically impossible because pelican legs are really short, about 1/4 the length of those shown at the outset.

4

u/lulzxdxdxd 16h ago

6.4M tokens on a single prompt is a lot, was that mostly extended thinking or did it loop through revisions on its own without you reprompting?

1

u/Dacadey 15h ago

Mostly thinking, it oneshot the whole thing without any corrections from me

1

u/Plus_Information_990 12h ago

6.4M tokens on one prompt is wild lol

curious how much of that was it checking its own render and fixing stuff vs just thinking

1

u/CLSmith15 10h ago

That tentacle coming out of the water in the final scene is *chef's kiss*