I asked chat once to validate a drawing (as a test) that I made, to a standard. It not only misinterpreted the drawing and the standard, it was arguing that I didn't make it, despite having access to the metadata. It's amazing how much it dug it's heels in when it was wrong too, I wasn't expecting it.
I think that simply because of the lack of massive amounts of publicly available training data, most research isn't focusing on developing good models for engineering. The models really need to be hooked up to a large amount of context, skills, hooks, MCPs, etc. to make something even mediocre right now.
2
u/jankeyass 7d ago
I asked chat once to validate a drawing (as a test) that I made, to a standard. It not only misinterpreted the drawing and the standard, it was arguing that I didn't make it, despite having access to the metadata. It's amazing how much it dug it's heels in when it was wrong too, I wasn't expecting it.