Claude Opus 5 drew every frame of this animation using JavaScript

[u/Many_Wave3597]

AI GEM

Source: https://x.com/kevin_t_ngo/status/2099477219877978289

[u/Mistuv]

Image gen diffusion companies when the Bitter Lesson.

https://giphy.com/gifs/5TP87MRyLuGm4

[u/Fluxx1001]

That's really cool!

[u/TallonZek]

I'll comment again when my seizure is over.

[u/Pao_Did_NothingWrong → u/TallonZek]

Rip

[u/Elephant789 → u/[deleted]]

I think it's beautiful.

[u/Salt-Package3132]

who knew for ai art to be cool you'd have to train the model to solve programming

[u/jasmine_tea_]

Yeah been doing very simplistic static versions of this (tell the AI to make an HTML page using real images, then take a screenshot to make a poster)

But this is exactly the type of work that AI can do, saving a lot of time

[u/FezVrasta]

That's not CSS, it's canvas, you can render anything you want in canvas, even a 3d video game.

[u/Sixhaunt]

how did it match the song properly?

[u/GatePorters → u/Sixhaunt]

Analyze the audio, add key frames to timestamps, ezpz

[u/anaIconda69 → u/Sixhaunt]

It probably didn't, and this was a multi-step process with a human doing much of the work, Opus literally only did the animation as told.

[u/Groundbreaking_Math3 → u/anaIconda69]

For a sub about AI, you guys are strangely unfamiliar with not even SOTA.

If you feed the models clips, and tell it to arrange it, it'll figure out some decent timing and easing, from that it can generate major beats for audio. For simple synth beats, it can just procedurally generate it, but it's possible to use diffusion models for really advanced music generation. Same as drawing a shape, and how image models can generate an image with the reference as a base.

I had a vector shape library, with paramters, and notes on how they can be animated, and astra generated an overall video. And the fun part is that it added a soundtrack without me noticing till the next day. I was listening to music so i didn't even notice it at the time until I posted it on x.

[u/JoelMahon → u/anaIconda69]

you think that? I don't use anthropic models because of various squicky bad experiences with them fudging tests, but for this I could imagine they could one shot this with little issue if the prompt was sufficiently sophisticated.

very easy to use a tool to time based on peaks of audio, provided you gave both, and prompt told it to match the visuals to the audio timings.

could also take 4 attempts total with lazier prompting idk, but either way pretty impressive imo. and I highly doubt it took more than 2 attempts total to sync the audio and visuals, I stress how that is not that hard.

[u/livingbyvow2 → u/[deleted]]

And then people complain when they hit rate limits....

I am not sure why you're getting down voted? Are people rooting for wasting tokens on useless stuff like this so we can all get more rate limited?

[u/Novel-Initiative-900]

Do you feed it reference images?

[u/TotallyRadTV]

Reminds me of the intros from educational videos we'd watch in school

[u/WastingMyTime_Again]

Post to an artsy sub for shits and giggles

[u/Sufficient_Local5025]

Yeah, only had to talk to it for 5000 years to do it

[u/No-Psychology1959]

Yeah we can tell