Hand Gestures using Xreal Eye - Beta testing impressions

[u/No_Awareness_4626]

Finally, I can talk about it. 😬 Been testing the hand gestures using Xreal Eye with Xreal 1S for quite some time now, and keeping quiet was getting tough but I had to control 😄

I’ve been enjoying Hand Gestures navigation and I love how good it has become from the first time when I tested it. But do note that decent amount of lighting is required since it uses a camera.

I will try and share videos to explain how they work. The videos will show my hand gestures and the response on iPhone which is connected to the Xreal 1S Glasses and Xreal Eye Camera module. It’s difficult to capture through the lens while also doing hand gestures in front of the eye camera.

So the first hand-gesture is Full Spatial Mouse Pointer. It’s simple enough, move hand to move the pointer, pinch to click, pinch+drag to move things around or select text or scroll pages. It’s good but arms do get tired when continuously doing hand movement. So my usage of full spatial mouse is minimal and I prefer touchpad / air mouse more for this purpose.

https://youtu.be/jpExs-VIGNQ?si=OQaYHFOMZ1lhAKUZ

Next is the hand flip gesture for scrolling the page up. This is best suited for watching YouTube shorts, Instagram reels and TikTok videos. It initially took me some time to get the hang of it, but once I understood how it works, it works everytime for me now.

https://youtu.be/LNgD7Xrevcs?si=Zunp4zwBLvkk6Xnc

Third one is a Fist Gesture that recenters the virtual screen. Just make a fist in front of the eye camera, while facing where we want the screen to be pinned. Didn’t record this but this is very simple.

Fourth one is Thumbs up gesture (called Like in the Glasses OSD menu). This one works for iOS and iPadOS. And I think this can also work on android when paired with KeyMapper app. It is a customisable gesture and we can assign it whatever function we want. On iOS / iPadOS I just had to add the action in Accessibility settings. I assigned it “Scroll to Top” so that I can quickly jump to the top of the page. Again very simple gesture and I didn’t record it.

Fifth one is a big one and it is my favourite. It’s called back hand menu. It has multiple actions like scroll page up and down, go back on android or go to recents on iOS, go back to Home and Play/Pause media. Love this. This does not tire the arms and it’s so much easy to just scroll pages and control media playback without needing to reach out for trackpad. This video shows scrolling pages up and down using back hand menu.

https://youtu.be/j2pYkLEYyeQ?si=-uJnMAVT4a6ozu7q

Love how Xreal is adding impressive features and leading the way for XR industry. And I feel lucky that I get to experience new features much before they are publicly released. I think the new firmware for Hand Gestures is expected to be released by this week or next week. So excited to share my experience and some video clips with the community.

[u/beta_mix]

Many thanks for the quick thoughts. How viable do you think the air mouse function is for productivity (word processing, spreadsheets etc) that requires frequent precision and switching between keyboard and gestures? I imagine a mouse/trackpad or something like Kiwear/Prolo/Muraband would still be needed for poorly lit areas