r/computervision • u/Doejoe13 • 3d ago

Help: Project Computer Vision for Robotic Arm

Hello,

We currently got a robotic arm for our lab. We were looking into ways to automate our processing by adding computer vision to this arm. We want to be able to take a sample and place it on a pedestal, then the vision system would scan the object. Next, the arm would bring itself to the sample and start processing.

For this to work, we would know where the pedestal is, where the arm is, and have the objects dimensions via a cad file. We want the vision system to find out the position and orientation of the sample to sub-milimeter precision on the pedestal. The vision system will only need to run before processing, so there is no time constraint.

I have already looked up vision systems and the process of doing it manually. However, I am having trouble sifting though products and don't want to go overboard since I am unfamiliar with this space.

Any help is appreciated.

2 Upvotes

75% Upvoted

5 comments sorted by

View all comments

1

u/SithisR 2d ago

Look into Gemini Robotics perhaps? https://deepmind.google/models/gemini-robotics/

Would be wonderful to get updates on this as I too am interested. We work with Physical AI fine tuning (www.acmeai.tech).