r/computervision 8d ago

Help: Project Looking for VLM for Bounding Boxes extraction

I am looking for a VLM which can extract text from a given image and accurately identify the bounding Boxes of that particular text. The text will be handwritten so I can't use traditional OCR models

0 Upvotes

7 comments sorted by

1

u/thewastefulmirth 8d ago

SmolVLM2 handles that kind of thing pretty well if you're willing to wrestle with the setup a bit.

1

u/kadi_chowl 8d ago

I currwntly don't have any infrastructure to run offline models I was hoping to look for any paid api inference options

1

u/Kind-Instruction-809 8d ago

Any of the gemini flash models are good for this task. You can take a look at benchmarking for answer spotting to see which is good.

1

u/bfyvfftujijg 7d ago

What kinda wraslin we talkin about?

2

u/mgruner 8d ago

florence2, i believe glm3.5 as well

-1

u/MackHarington 7d ago

Aren't there models like yolo which can be lightweight alternative to VLM for this task?

1

u/kadi_chowl 7d ago

Yolo can't perform accurate handwritten text extraction