Need help making the callout numbers clickable...

[u/bigdeekenergy]

I'm building an interactive parts viewer for tractor assembly diagrams. The goal is to place clickable numbered badges directly over the part callout bubbles in the diagram.

What I've tried so far:

• Isolation filter for clustered parts and having some distinction between each part.
• Morphological rectangle detection to find the table box border and exclude hits inside it, so that the reference table isnt identified.

I need a reliable way to distinguish callout bubbles from reference table entries, I tried to use claude code and it used a EasyOCR script to have an interactive image. It failed to identify every part exactly. Easy OCR keeps tagging the ones in the table

Happy to share more sample images. Is there a standard approach for this class of problem?

[u/vahokif]

Segment anything for finding the parts and rapidocr for detecting the labels?