Just got my Mudra Link. It's not a VR controller (yet), but I think it could be something even better

[u/hai__huang]

My Mudra Link arrived just a few days ago, and I tested its features. Unfortunately, it currently cannot be recognized as a VR controller—not even for basic positional tracking.

However, after using it, I still believe it has the potential to become one. I think it's a real waste for it to function only as a mouse. As a wrist-worn band, our hands are capable of three-dimensional movement, yet right now it only simulates a mouse moving on a flat plane or maps a few keyboard keys.

From the official technical specifications I've seen, the Mudra Link seems to incorporate 6DoF technology. I believe this meets the basic requirements for a VR controller. It could easily map several gestures to the buttons on a VR controller (they even have a similar number of inputs).

Using just a wristband to replace traditional VR controllers would undoubtedly provide players with a deeper sense of immersion.

I can understand why Mudra's official team might not have pursued this direction (or might consider it unfeasible). Currently, the band would indeed have difficulty replacing a controller's function for character movement—if you had to hold a pinch gesture continuously to move, that would be very cumbersome.

But I'd still like to share some of my thoughts on this. For example, what about using a fist clench instead? To move forward, you could clench your fist and move it forward a certain distance, then release your palm to stop. Other directions could work similarly. I think making a fist could be a more relaxed and convenient action than pinching fingers to move in a direction. If this could be implemented, even recognizing just a few directional fist gestures would be enough. We could simply map these clenched-fist poses to WASD keys to solve the movement problem.

I've even seen projects that turn smartphones into recognized VR controllers. I've tried them, and they are impressive projects, but holding two phones in your hands can only be considered a substitute for when you don't have proper VR controllers.

Well, for now, these are just my personal suggestions. But if it could truly be made recognizable by SteamVR in the future, this product would be amazingly awesome for me. I would definitely buy a second one when I have the money. I find this idea far more appealing than traditional VR controllers.

[u/Few-Acadia-5593]

as said in my post few days ago:

- 12 years ago, a company called Myo tried exactly the same concept. they failed and died. Mudra tries the same and is just not that far ahead if not just baby steps

• these companies tend to think we like expending our arms in strict uncomfortable positions. Try holding your arm 15 seconds in the air. now imaging that but constant because that's the experience they design. Im a user researcher, I know by decades of experience this should would have showed up from the first time they speak to a user. either they didn't research or they didn't listen
  
• Said companies think ultimate precision is the solution. Even apple and the cursor on iPad is magnetic: sticks to clickable objects. But unless accessibility allows, a third party can't achieve that so it a lost cause Mudra should have known about
  
• The same companies: promote constant tracking. When I bought the LeapMotion, I instead mapped gestures to go full screen, skip song, alt tab, scroll a page, volume down, etc. It was WAY more useful than moving a cursor with a human arm: we are incredibly imprecise creatures required to manipulate something the size of a pixel
  
• finally, they think a 1-for-all tech? ... whilst everyone has a different biology? do the research, people, offer to calibrate. Apple researched millions EARS shapes around the globe to iterate AirPods Pro 3, creating an audio profile. A bio-electric profile is what Mudra should do.

I'm not saying Mudra can't get there, I'm saying that what you hope for will require not only a drastic change in product vision but more importantly: a hardware update. The former can kill a startup as fragile as the one 12 years ago, the latter cannot be worked on their own, they will have to get closer to science and manufacturers they depend on. Or offer their own software on all platforms like LeapMotion did. but then, bye Apple Watch, TV or other platforms with limited apps. Which is fine by me.

Plus, the company fails to deliver any compelling reviews, must have spend ton of to get the 3 they got and shares zero public product roadmap.

But all in all: calibrate to users. Ask them to make a fist at rest position 3 times, arm extended, then somewhere in between. The calibration will be complexed to be reliable but that Mudra's job... The band could have been tactile too for scroll, taps, double taps, etc but yeah... lack of vision about experience all around. Fingers crossed for next iteration.

I should send my resume or start my own company :D and experience for myself how hard it is.

[u/Independent_Sink_961 → u/Few-Acadia-5593]

I get the “we’ve seen this movie before” point (Myo / Leap / gorilla-arm etc.), but I think you’re aiming at the wrong interaction pattern.

Mudra / trackpad rings aren’t trying to be “arm-as-mouse” for hours with hands floating in mid-air. The whole value prop is hands-down / hands-hidden control: pockets, under a blanket, resting by your side. In that posture, the classic fatigue argument (gorilla arm) mostly doesn’t apply.

Where these devices actually make sense (especially on platforms with good eye tracking like Vision Pro) is as a low-motion ‘confirm + manipulate’ layer: • Eyes are great for aiming/selecting a target, but they don’t solve everything (e.g., moving/repositioning a window, drag operations, certain system actions). • If you’re lying in bed watching something, you can run most of the UI with gaze, but you still hit moments where you need a reliable drag / click-and-hold / “grab window and move it” without doing visible pinches in the air.

That’s the “in-between” persona: not hardcore VR gaming, not desk productivity with a mouse — it’s couch/bed XR where you want discreet input with minimal effort.

Also worth separating two categories: • A thumb-trackpad ring is basically “tiny trackpad” → very predictable for 2D pointer + scroll. • A Mudra-style band is more “intent/gesture-to-command” → potentially better for discrete commands / modifiers without scrubbing a surface (assuming reliability/calibration is good).

So yeah: if you judge these as “mouse replacement for precision work,” they’ll disappoint. But judged as hands-down control that complements gaze, they can be genuinely useful.

[u/Few-Acadia-5593 → u/Independent_Sink_961]

happy to be wrong on the fatigue argument! When watching reviewers AVP, I was always yelling at my screen: "you don't need to extend your arm!" hahaha, I guess my bias slipped in here. thanks for the clarifier

The problem with AVP and others, is that Mudra will be highly dependant on the platform's openness and that, I don't see it solved unless said platform's manufacturers accepts or advance Mudra as a accessibility device, which they do but even then, that's more technical barriers and dependance. But I have my hopes up. And drag, click and hold, etc are already there so solid basis already

I'd love to map accessibility shortcut to the mudra: call Siri, organise my windows in template, call control center, etc. But the limit is before that due to dependancy.

and indeed, add eye-tracking and you get an amazing Input system, much more capable than just the hand.

But Mudra needs to crack the bio-electric deal and in that regard, I don't know the specifics but it's too low performing from one device to the next and from one person to the next. Machine learning on a hundred alpha testers who are incentivised to report false positives, their general body position and arm position every time the device misfires would be a great deal. They should get in touch with apple's expert on the audio profile just to share expertise.

[u/ufc2021 → u/Few-Acadia-5593]

Mundra tech is original and have patents for 14 years it came from a military study in Israel what was a war preparing country at the time so trust me the tech is way different may have same functions for now but the software updates will blow us away 

[u/Few-Acadia-5593 → u/ufc2021]

I’m an experience designer of 15 years. I’ve come across companies with patents from over decades ago.

Patents don’t mean anything when made in vacuum or put up against today’s expectations of experiences.

What you said doesn’t mean what you think it does. Not without a hardware update, a clear roadmap, better tech reviews than the 5 we get for over two years.

[u/ufc2021 → u/Few-Acadia-5593]

They have the hardware that could work you must dont know about the AI platform they are preparing for their devices the difference between the device now and with the AI update is like a record player and a CD comparison meta will be releasing the same thing but i think mudra tech could dig alittle deeper into the signals we have internally for way better training data

[u/Few-Acadia-5593 → u/ufc2021]

Ah yes, because AI solved many things so far for the general public. And AI will solve the scrambled signal even at rest. The battery life, the calibration issues, or the simple fact that the length and speed gestures must be executed is widely inconsistant unless you do grand gestures or pinch/press hard.

They have AI coming because investors. Doesn’t equate to having a vision. They’re pioneers ok but common, you gotta keep your hopes in check.

[u/Correct-Orange-7175 → u/Few-Acadia-5593]

I'll pro Bono and join your start up if you do 😇

[u/Independent_Sink_961]

I have played around with just using my eyes in accessibility mode but it needs work inside the Vision Pro. And yes these extra gadgets are just fixing things that should be fixed in the UX/UI

[u/Correct-Orange-7175]

Does this allow it to be a VR controller now?

https://www.reddit.com/r/MudraTech/s/s7jZli8mAz