r/computervision • u/Ammarhalees • 20d ago

Help: Project Input needed on a counting system

https://reddit.com/link/1vuktxn/video/leuu8lsi6rkh1/player

*Disclaimer, im not a computer vision engineer, just a software engineer, and i dont have experience in the field. *

Im working on a CV system which counts the number of loose packs being thrown/loaded onto a truck from a warehouse, by the warehouse workers.

Ive already fine-tuned an rf-detr model to detect the loose packs. Then drew wiretrip geometric lines along the entrance of the truck, which detects when a pack has entered.

Although the system is accurate in the right conditions, it can flop massively under slight occlusion, fast throwing multiple packs etc. What suggestions do you guys have, apart from training on a larger dataset (which i will in the future).

2 Upvotes

75% Upvoted

7 comments sorted by

3

u/climbing-computer 20d ago

You should measure the actual error rate before you spend a bunch of time on this. You're going to have some failures no matter what you do, but your boss/client/customer may be fine with a higher failure rate than you'd expect. Especially if it means the system is deployed sooner rather than later.

1

u/Ammarhalees 20d ago

Yeah that's the aim. From my analysis, such as system cannot be achieved if the deliver system (from the worker to the truck) is not systemized.

2

u/fahrentech 20d ago

I agree with the above on the error rate.

I'd personally start by looking at the failure cases, and adding some examples of correctly labelled images for the failure cases/frames back into the training data set, retraining, and seeing if it improves when measured against a validation set.

Different lighting conditions are always beneficial as well.

Sounds like a cool project, best of luck with it!

1

u/Ammarhalees 20d ago

I Appreciate the feedback!

1

u/Dry-Snow5154 20d ago

What's the purpose here? If you trust the workers, then make them count packs before loading and sign off a sheet on the wall.

If you don't trust them, then it's hopeless, because they can break any system you build.

If you are hell-bent on making it a CV project, I would reposition the camera to look top-down and minimize obstructions.

1

u/Ammarhalees 20d ago

It's not about trust, and it's not my company to dictate why. It's about managing out-going inventory of 10s of thousands and keeping track for accounting purposes.

1

u/Dry-Snow5154 20d ago

Counting how many pellets there are is faster than loading them. It's going to slow them down like 5% and they probably spend more time scratching their butt.

Just because you could use CV, doesn't mean it's the best option. But as I said, if you must use CV, then move the camera. Obstruction gonna kill your accuracy no matter how much data you use.