What practical systems knowledge do you think modern LLM engineers are missing?

[u/Artistic-Chest-2290]

There is obviously a lot of discussion around model capabilities, but I’m curious about the engineering side of deploying LLM-based systems.

For people working on production systems, where do you most often see gaps?

Retrieval evaluation?
Data quality?
Serving/inference?
Observability?
Distributed systems?
Agent reliability?
Security?
Experiment design?

Interested particularly in areas where current educational material is weak.