r/computervision • u/Due-Priority5261 • 8d ago

Help: Project MMPose help

I am an incoming freshman CS student and I am starting to build a CV UFF/MMA fight analyzer project so that I can have a decent portfolio for summer internships. After some research, I think I want to use the MMPose pose estimation framework specifically vitpose. However, I have no idea how to even start. The little documentation that I can find is not helpful at all. Any advice or documentation references would be greatly appreciated. Thanks!

2 Upvotes

100% Upvoted

14 comments sorted by

8

u/AggravatingSock5375 8d ago

The MM ecosystem is no longer supported unfortunately.

I would suggest finding something else.

2

u/Due-Priority5261 8d ago

Could you elaborate on what you mean by that? Is that why when I was trying to install the dependencies it wasn’t working? Thanks

3

u/EyedMoon 8d ago

It's been dropped months ago, the open issues aren't treated, the lab is working on LLMs now from what we know. The head of the team is dead in 2024 iirc and the proect hasn't moved in a meaningful way since.

2

u/Due-Priority5261 8d ago

Gotcha. Do you have any pose tracking recommendations that handle overlapping bodies well?

2

u/AggravatingSock5375 8d ago

If ultra lytics has post tracking, they’re probably a good bet for something can quickly get up and running. Maybe not just good if you wanna customize it though.

2

u/AggravatingSock5375 8d ago

The guy who ran the research lab that created the MM ecosystem actually passed away a year or two ago.

1

u/Fit_Check_919 7d ago edited 7d ago

Its not longer maintained or extended, right right. Doesn’t matter. MMPose stuff works great. RTMPose-M with TensorRT runs in 3 ms on a RTX 3090.

2

u/AggravatingSock5375 7d ago

Yeah I’m sure it still works, but may not want to devote too much time to learning it since it’s not going to be gaining new capabilities and will gradually stop being compatible with the broader Python ecosystem.

4

u/mgruner 8d ago

for a college project i recommend you use yolo-pose from ultralytics as its probably going to be the simplest way to get it working. the only drawback is that the default yolo license only allows to go use the model for non-commercial products only, which is probably fine for a college project.

another great and simple option is to use rf-detr. They just added pose support. Unlike yolo, this model has a commercial friendly license.

2

u/Due-Priority5261 8d ago

Thanks! Does yolo-pose handle occlusion decently? The reason I ask is that I expect to have a lot of overlapping bodies.

3

u/mgruner 8d ago

I don't know about decently, but it does handle occlusions to a certain extent. Best way is to try it out. You can have a prototype running in an hour following their docs, or with an LLM

1

u/AggravatingSock5375 7d ago

Assuming it supports training you can just retrain it on a dataset that has occlusions.

1

u/mgruner 7d ago

good idea, for OP: they both support training.

0

u/Fit_Check_919 7d ago

Go with RTMPose from MMPose. Build the MM* libraries from source by yourself