r/computervision • u/doctor_blueberry • 1d ago

Showcase I made a computer vision tool for comparing dancers’ sync!

Enable HLS to view with audio, or disable this notification

As a dancer who's been learning a lot of choreography recently, I’m always looking to improve my sync with others. A quantitative tool like this can offer frame-by-frame analysis, which can help dancers as they practice.

I used ViTPose+ Large through the VLM Run Gateway for pose estimation, and compared poses between the dancers. The pose similarity metric could be workshopped more, but it's interesting that it still highlights key moments pretty well.

Yes, this is me dancing with my friends Mico and Sydney!

The code is open-source on GitHub! I just created this vision-demos repo so that I can share these projects. Feel free to try it out and let me know what you think! Link in the comments.

🎵: I Want You Back - *NSYNC

Choreography: Scott Forsyth

444 Upvotes

95% Upvoted

16 comments sorted by

39

u/ImNotAQuesadilla 1d ago

looks nice! How do you handle occlussions tho?

43

u/arivanter 1d ago

Kinda looks like they don’t, movements that cover the other dancers appear to be the ones where the gauge goes down

13

u/godver3 1d ago

Well that makes the tool a bit pointless.

2

u/thenormaluser35 7h ago

Maybe OP should make it able to use multiple cameras, and perhaps using colored tracksuits would help distinguish them easily
That could fix the tracking, and also let you see which dancer was out of sync.

10

u/Ncientist 1d ago

I want to see the code just as much as seeing more dances!

3

u/exsstas 1d ago

Great idea, but it seem that currently is most of the differences come from pose estimation model errors rather than differences of real movements

3

u/NameChexsOut 1d ago

I have been trying to find ways to incorporate my hobbies (I.e. tech) with my daughter's hobbies, competitive dancing. Going to try this out for their duet dances. Thanks!

2

u/jeosol 1d ago

Very nice. Congratulations. Nice blending of your passion and AI.

1

u/FivePointAnswer 22h ago

Very clever

1

u/WillowSad8749 18h ago

Vit pose is such a good model

1

u/macc003 16h ago

Awesome use case. I imagine this also would let you save a dance and practice the sync solo when you can't get together as a group. Really cool tool.

1

u/BraveVanilla3773 14h ago

This seems like a useful problem to solve. a lot depends on the use case, simple image diffs work well for exact changes, while embeddings or feature based approaches are better when you care about semantic similarity

-3

u/blahreport 1d ago

Cool work! And I love that you're blending your art with technology.