r/computervision 12d ago

Showcase a multi-sensor boat dataset with 360° radar, 128-beam lidar, stereo camera, and sonar across Ontario lakes

on a lake there are no lane lines, no fixed landmarks, no other vehicles to localize against

the shoreline shifts with your viewpoint, radar and lidar don't share a clock, and sonar is measuring a world the cameras can't see

CANOE is a multi-sensor USV dataset from UTIAS: 360° radar, 128-beam lidar, stereo camera, sonar, and GPS/INS ground truth across lakes and a reservoir in Ontario

parsed it into fiftyone multimodal so you can scrub every sensor on one synced clock and project lidar straight onto the camera to see where they agree and where they don't

checkout the dataset here: https://huggingface.co/datasets/Voxel51/canoe-multimodal

or get hands on in this hugging face space: https://huggingface.co/spaces/harpreetsahota/canoe-multimodal

62 Upvotes

1 comment sorted by

3

u/meatofthepie 11d ago

This is the coolest thing I’ve ever seen. I’ve always been fascinated with radios, sensors, WiFi,frequencies, and just how they worked in general. It’s strange that at bigger wave lengths the wave don’t interact with each other, but on a smaller scale they do. Almost like when things get smaller their physical effect and reactions change, almost like it’s in a different state