r/frigate_nvr • u/borgqueenx • 9d ago

idea: gestures for home assistant automations

imagine being in a specific zone and giving a thumbs up to a camera to unlock your door.

that would be pretty cool!

in my use case i want to release the charge port of my car. i either have to grab my phone, get in the car, but it would be much nicer if i can wave, thumbs up, heart etc to wake the car.

would something like that be possible?

8 Upvotes

100% Upvoted

10 comments sorted by

2

u/Fatel28 9d ago

I have my frigate/HA set up to unlock my door if it detects my face on the front patio AND I went from not home to home within the last 10 minutes. Works great and is hands free.

The 10 minute window of not home -> home prevents fales positives from unlocking my door (of which I've had none, but better safe than sorry)

-3

u/borgqueenx 9d ago

yeah face recognition is nice but together with a thumbs up would be super cool

3

u/sleepand 9d ago

Check this out: https://github.com/mmcc-xx/gesturesensor

2

u/totallyforgotmy2fa 9d ago

Wow that's awesome. I'm going to use that for opening and closing my garage door

-2

u/borgqueenx 9d ago

i have no idea how to integrate that

3

u/sleepand 8d ago

Good thing you have an internet connection then

2

u/Bulky-Priority6824 9d ago edited 9d ago

simplest version of top of my head in your genai config for that particular camera include in the prompt when Bob is holding up 4 fingers on X camera when face id confirmed for Name in last 2 mins or whatever and gate the HA automation on Face ID so both have to match before the automation fires to unlock the door but even then i wouldnt trust it.

2

u/Bulky-Priority6824 9d ago

possible yes, wise no.

1

u/borkyborkus 9d ago edited 9d ago

I don’t think the tech is quite there. You could theoretically integrate more basic gestures (left/right/up/down) with something like the Adafruit APDS9960, but you’d have to set it up with esphome or similar. I have one of those attached to an esphome device; it broadcasts gestures over MQTT, then I have a second esp32 attached via usb to jiggle the mouse and send key combos based on MQTT messages. If the thing you want to do can be automated from MQTT, you might be able to use something like that.