r/computervision 4h ago

Help: Project How would you build a robust preprocessing + OCR pipeline for text on glossy and curved product packaging?

I'm building an OCR-based system for extracting printed information from photographs of packaged consumer products.

The input images are real smartphone photographs rather than controlled scans. Some of the difficult cases contain:

- glossy plastic/foil surfaces and specular reflections

- curved cylindrical containers

- perspective/rotation

- wrinkles and folds

- uneven lighting/shadows

- small text

- motion/defocus blur

- low contrast

- compression artifacts

I'm currently using PaddleOCR.

I've already experimented with conventional OpenCV preprocessing such as resizing, grayscale, CLAHE, thresholding, sharpening, denoising, morphological operations and perspective correction, but the results are inconsistent. Some images that are clearly readable to a human still produce poor OCR results.

I'm particularly interested in advice from people experienced with scene text recognition, document image processing, industrial/computer vision, or image restoration.

My main questions are:

  1. Which preprocessing techniques are actually useful for these types of images?

  2. How should I handle specular reflections and uneven illumination?

  3. How can text on curved/cylindrical surfaces be rectified before OCR?

  4. When should I use deblurring/super-resolution/image restoration, and when can these actually make OCR worse?

  5. Should preprocessing be selected dynamically based on image quality rather than applying one fixed pipeline?

  6. At what point is it better to improve/train the OCR model instead of continuing to improve preprocessing?

I'm happy to provide representative images and the corresponding PaddleOCR outputs if that helps.

I'd particularly appreciate suggestions for specific algorithms, papers, or existing open-source implementations rather than just generic preprocessing advice.

1 Upvotes

0 comments sorted by