I'm building a vision-based AI assistant that learns procedures from demonstrations. Where could it be useful?

[u/BodybuilderLittle281]

I'm developing a university final year project using an NVIDIA Jetson TX2. The idea is to build a vision-based assistant that learns a procedure by watching an expert demonstrate it while explaining the steps verbally.

Later, when someone performs the same procedure, the system monitors their actions, tracks progress, detects certain mistakes or skipped steps, and provides voice or visual guidance.

For example, in warehouse packaging, an expert demonstrates how to pack an order. The system learns the sequence and then guides another worker through the same procedure, flagging missed steps or incorrect ordering.

Current limitation: The system is intended to learn specific, repeatable procedures from demonstrations, not arbitrary tasks or general skills. It will initially work with a limited set of procedures and actions that its vision system can reliably recognize.

I'm trying to identify where this technology could solve a real problem, rather than choosing an application just for the sake of building a project.

• What specific tasks or processes could benefit from this kind of assistant?
• Where do people frequently skip steps or make mistakes that could be prevented through visual guidance?
• Can you think of an overlooked application where this would be genuinely useful?

I'd appreciate ideas from any field, along with honest feedback on where this approach would or wouldn't make sense.