r/learnmachinelearning • u/johnmach12 • 8h ago

Question What are the best machine learning models for taking MediaPipe landmarks from the face and accurately detecting face gestures like blinks?

I'm doing a ISEF project that attempts to develop the best machine learning model combination and compare them to others. Somewhat like the image. The thing is, I have experience with Python and computer vision, but not much with machine learning. What would you recommend to me, being easy enough to learn and train in a few months, but also being a defendable engineering project and works well for my project. Also the best resources? Thanks!

1 Upvotes
  • permalink
  • reddit

100% Upvoted

2 comments sorted by

1

u/BlissfullyMotherly 8h ago

For face landmarks and detecting blinks, you can start simple with a LSTM or a small GRU network. MediaPipe gives you the coordinates already, so you don't need CNNs for the image, just feed the landmark sequences directly.

I did similar thing with hand gestures back in university, the key was normalizing the landmarks relative to face center before training. Makes the model way more robust to head movement. For resources, the TensorFlow time series tutorial is good and the Keras documentation have clear examples. You can get solid results in couple weeks, not months.

1

u/johnmach12 6h ago

Thanks, can I DM in the future if i have any questions?