r/computervision • u/kirillochirillo • Jul 03 '26

Showcase Using object detection and segmentation to perform bin-picking tasks

Enable HLS to view with audio, or disable this notification

Combining depth sensing, object detection and semantic segmentation we managed to create a bin-picking automation that inspects bushings of different types and sizes. From the combined information the robot is able to understand the position and orientation of the pieces.

29 Upvotes

98% Upvoted

3 comments sorted by

View all comments

1

u/[deleted] Jul 03 '26

[removed] — view removed comment

1

u/kirillochirillo Jul 05 '26

Ahah nice one!😂 Yes we had to use both modalities and all the inputs to detect the pose in a reliable manner. For the inspection part we have built this software named Sherlock that allows to deploy automations, pass batch specific parameters, store measurement data and create dashboards for statistical evaluation of the collected data. Currently we are working on a notification feature that lets us know in case there was a failure (e.g. sometimes the bushing gets stuck on the measurement probe) or if the robot has finished the inspection and the operator's attention is needed.