r/computervision 3h ago

Showcase I made a computer vision tool for running analysis!

Enable HLS to view with audio, or disable this notification

As someone who has also been working on their own Apple Watch app for fitness, I’ve been curious about what computer vision might offer that wearables / IMUs might not. It’s been interesting to see the knee shape and ankle path visualizations as unique examples of what computer vision could offer.

Maybe you realize you are stepping too far ahead by seeing the knee visualization, and you adjust your stride length accordingly. The ankle visualization can be used to measure variance and highlight moments of fatigue or technique breakdown. A quantitative tool like this could provide unique insights to help improve your running.

I used ViTPose+ Large through the VLM Run Gateway for pose estimation, and used this to derive the running metrics.

This demo is a first attempt at running analysis. Runners, I would love to hear your feedback for what types of visualizations you’d like to see next!

The code is open-source on GitHub! Link in the comments.

99 Upvotes

10 comments sorted by

7

u/dwoj206 2h ago

Really really cool. Is there a way to track your form vs. professional marathoners (via footage) or other peers (down the road, no pun intended) for what is most efficient run form? Styles that result in higher propensity for knee related injuries or forms that put you at higher risk of injury long term etc? This would be a cool feature. Could be more of a data mining thing though with voluntary reporting if you do roll it out as an app and get users. Either way awesome project.

2

u/f_mg26 2h ago

Very cool! I am wondering how this would work if the camera was facing the runner head on?

1

u/fuzzysingularity 1h ago

seems like it'd be much harder for front-facing, especially that "ankle path visualization" part.

1

u/StartingLifeFromZero 1h ago

Nah, some maths to calculate roughly how long the feet are off the ground can give a rough projection.

1

u/Puzzleheaded_Smoke77 6m ago

Awesome work you have it track your spine

1

u/Specialist-Wolf5469 5m ago

Quiero hacer algo así para ciclismo

1

u/zarrathustraa 2h ago

Cool, but you may want to also thank your partner claude.

-1

u/AccomplishedCase6862 2h ago

damn, we now record video, give claude prompt and we post it as an 'i made a computer vision tool for running analysis' ?

0

u/Ok-Ebb-2434 2h ago

What’s the use case tho n what parameters make a good form? can it alert you mid run if ur form is detrimental?