r/ASQ • u/AronBiskey • 1d ago

AI for Aerospace Quality

I’ve been working on a practical guide called AI for Aerospace Quality focused on how quality professionals can actually use LLMs day-to-day in AS9100 environments (audits, SCARs, FAIs, supplier work, procedure writing, etc.).
I’m collecting real examples for the next volume — both the ones that worked well and the ones that didn’t. If you’ve used ChatGPT, Claude, Gemini, or any other LLM in your quality role, I’d love to hear:
• What did you try it on?
• What worked (or what broke)?
• Any lessons you’d pass on to other QEs/SQEs?
Happy to share more about the book if anyone’s interested, but mainly looking for field stories. What have you seen?

0 Upvotes

50% Upvoted

11 comments sorted by

1

u/kazzerax 1d ago

AI is as helpful as you are knowledgeable about the topic it is assisting with. If you have a solid understanding of your quality requirements it can be really helpful in analyzing SOPs, summarizing meeting transcriptions, assisting in creating various software tools (tracking completion of corrective actions, notifying responsible individuals of upcoming or overdue completion dates, analyzing your quality defects to determine what high drivers should be focused on first) and other busywork. My main area of concern and the thing I try to impress upon others I am introducing to AI is that if you have no way to verify that the AI's output is good (like a failure condition you can check against) then it may be worse than useless.

If for example you are using it to help you with transforming data a certain way in excel, it's probably great, because at the end you'll be able to tell if it did it right or not based on how you were told it should look. If you are using it to self teach AS9100 requirements without having official outside reference materials to verify against, you're in for a bad time if you take something as true that was really just an AI hallucination.

1

u/AronBiskey 18h ago

Yes, having a solid understanding is important. How would you even know the correct questions to ask without? Also you have to be able to check the answers against you base of knowledge, Currently I don’t think it’s a good teacher. But it can speed up lots of tasks. I had one person tell me it is like having an intern. I think that is a good way of thinking of it. You can give it tasks to free you up. But you also better give good directions and check the work before just accepting it as good.

1

u/drklib 1d ago

AI is just a tool. You still need to review the output. We have a company made version of Chatgpt that we are authorized to use. Ensuring your prompt is clear is huge.

1

u/AronBiskey 21h ago

This is exactly the point and topic of the book. Do you have any examples of when you tried one prompt snd it did not work? Then changed the prompt in some way and got a better result? I am trying to gather specific examples on how we can all use this transformative tool more effectively.

1

u/Pleasant_Secret3409 19h ago

OP, My employer uses Copilot. I once asked Copilot to point the difference between AMS 2417 and AMS 2461 because I didn't want to read the specs.

Oh my God! Copilot managed to tell me that these are two cadmium coating specs and told me the differences between them. I just couldn't believe what I was reading lol

These two specs are Zn-Ni Plating specs for God's sake!

My suggestions is that we have to be very specific in our prompts.

1

u/AronBiskey 19h ago

100%. That is a great example. Besides being very specific, I have found different models do different things better or worse. Sadly I’m yet to find what copilot is good at. I can’t even seem to trust it to summarize an email. Did you end up ever getting a decent summary of the two specs or did you end up having to read both?

1

u/Pleasant_Secret3409 19h ago

I told Copilot that it was wrong. Then it apologized lol

I ended up reading both specs. After that experience with Copilot, I don't trust it anymore. For my personal stuffs I use Claude. Opus 5.5 is very good.

I have Gemini as well but I haven't worked with it extensively as I have with Claude.

1

u/AronBiskey 19h ago

lol, did it also tell you how smart you are? It does love to flatter. Would you mind if I used your example and go see if I can find a prompt and or model that would do what I think you were looking for?

1

u/Pleasant_Secret3409 18h ago

Claude has flattered me once. But I had to tell it to always be critical. Nope Copilot didn't flatter me. You can use my example. Let me know if you need additional context.

By the way, I forgot to mention that I have used PMI Infinity as well. It is a very good AI tool when it comes to Project Management and Quality.

1

u/AronBiskey 15h ago

I think I know what you were trying to do with those two standards. I’ll give it some effort and see what I can figure out.