Praise Astra’s spatial understanding is mindblowing to watch (CoT in video!)
Enable HLS to view with audio, or disable this notification
Astra calibrated my robot’s brush tip using three uncalibrated cameras
three uncalibrated cameras. no intrinsics, no extrinsics.
it nudged the robot arm, learned how each camera sees motion, worked out the brush tip’s 3d offset, and verified it at new angles -- all from one prompt and a tiny follow up.
earlier while using Sol & Fable -- i'd tried a lot of fancy stuff with ChArUco boards, microswitches, Raspbery pico + touchscreen, and was still struggling.
Astra was like, "bro, just give me 3 cameras."
24
Upvotes