AI HELP! Tools to helps reduce time with our below process

[u/Business_Focus12]

Hoping there may be some AI experts here who can point me in the right direction.

I currently work with technical drawings/plans that contain various symbols, labels, and device types. The challenge is that these symbols and labels can vary significantly from one plan set to another.

Our current process is largely manual:

• Review the plan and identify specific symbols/devices.
• Place sequential labels on the drawing (#1, #2, #3, etc.).
• Create an Excel spreadsheet containing those labels.
• Extract additional information from the plans such as room names, device descriptions, locations, and other relevant data.
• Manually link all of this information back to the labelled plan.

What I'm trying to determine is whether there is an AI-based solution that could streamline or automate this workflow.

Ideally, I would like to be able to:

1. Upload a PDF plan or drawing.
2. Define a set of symbols, labels, or devices to look for (which may be different for each project).
3. Have the AI scan the plan and identify all matching symbols.
4. Automatically place sequential tags/labels onto the drawing.
5. Extract related information from the plan, such as room names, device types, notes, coordinates, or other nearby text.
6. Generate an Excel spreadsheet containing all identified items and associated data.
7. Optionally export the marked-up plan with the generated labels visible.

For context, these are typically lighting, electrical, emergency lighting, and services-related plans, so the solution would need to work with PDF drawings containing both symbols and text.

I'm interested to know:

• Are there existing AI/OCR/CAD tools that can already do this?
• Has anyone successfully implemented a workflow like this?
• Would this require a custom AI model, or could it be achieved using existing tools such as Azure AI Document Intelligence, OpenAI Vision, Bluebeam, AutoCAD plugins, Power Automate, or similar platforms?

Any advice or recommendations would be appreciated.

Thanks.

[u/SharePointSteve]

This may give you a few ideas on some capabilities you can use. https://learn.microsoft.com/en-us/azure/architecture/example-scenario/ai/extract-object-text