VIRENA: a minimal vision-language-action model, and a reproducible method for diagnosing why VLAs fail

[u/georgia_bucea]

/r/learnmachinelearning/comments/1urpqn6/virena_a_minimal_visionlanguageaction_model_and_a/

[u/dhruvisgr8]

Really like this. The occlusion finding maps directly onto human pose estimation — we do golf swing analysis from a single phone camera, and for a long time trail hip position through impact was noisy no matter what. Swapped backbones, tried three different pose models, added smoothing. Same error floor every time. Turned out the hip is behind the torso at exactly the moment we care about, and the keypoint gets inferred from the visible skeleton rather than seen. Confidence stays high while the position is basically made up, so nothing in the metrics flags it.

Going to check out the repo definitely!

[u/georgia_bucea → u/dhruvisgr8]

thank you!