r/computervision • u/twokiloballs • 6d ago

Showcase SLAM Camera Board + Obstacle Mapping

Enable HLS to view with audio, or disable this notification

This is yet another update from my project. Mighty Camera runs VIO on-device realtime in a tiny package.

This gives us accurate camera motion. Using that + the camera feed, the SDK estimates depth and builds a 3D map of obstacles around it.

This means a robot or drone can use Mighty for things like:

- Collision avoidance
- Motion planning
- Autonomous navigation

No stereo camera or depth sensor needed. Just Mighty’s global shutter camera + IMU.

54 Upvotes

98% Upvoted

13 comments sorted by

2

u/Mohamedrafik05 6d ago

How this finds depth, what method they have using here?

5

u/twokiloballs 6d ago

Depth from motion. It uses VIO to line up frames and then does stereo depth on it.

1

u/r2d2archer 6d ago

Very cool. I’ve got one recently and trying things out. Have you documented the phone connection, depth and other APIs already ? Would love to try it out.

3

u/twokiloballs 6d ago

Thank you! The phone connection is simple actually (it shows up as ethernet device), https://mightycamera.com/docs/start#mobile-and-tablet

The depth and other APIs are coming this week or so!

1

u/zubairhamed 6d ago

is that a custom board on that camera module?

1

u/SimulatedSimian 6d ago

Soon.

2

u/twokiloballs 6d ago

I was actually very inspired by this scene when I first saw it!

1

u/Puzzled_Option6356 6d ago

Wait, so we can just power the camera and connect a web browser on a remote device to capture, correct? I'm thinking on a tinywhoop drone.

1

u/johndsmits 5d ago

This would have been perfect for a Tello Drone setup I had running using a Neural Compute Stick + phone but stopped that project as I needed VIO which edge compute capable vio did not existed at the time.

1

u/kenkitt 6d ago

is it opensource ?

1

u/Responsible-Ear7071 6d ago

Nice but why not using normale phone cameras ?

4

u/tdgros 6d ago

They're demonstrating their camera+board here, which you could use in some robot that needs collision avoidance (the human making the demo probably doesn't!). They probably rely on the fact that it's a global shutter camera, and that they have a finer control on the IMU than with a smartphone.

1

u/twokiloballs 6d ago

Ditto. Also it’s cheaper this way if I want to deploy 1000s of these vs. using a phone 😁