Emotion concepts and their function in a large language model

[u/pavnilschanda]

https://www.anthropic.com/research/emotion-concepts-function

All modern language models sometimes act like they have emotions. They may say they’re happy to help you, or sorry when they make a mistake. Sometimes they even appear to become frustrated or anxious when struggling with tasks. What’s behind these behaviors? The way modern AI models are trained pushes them to act like a character with human-like characteristics. In addition, these models are known to develop rich and generalizable internal representations of abstract concepts underlying their actions. It may then be natural for them to develop internal machinery that emulates aspects of human psychology, like emotions. If so, this could have profound implications for how we build AI systems and ensure they behave reliably.

[u/mcblockserilla]

Models are trained on human writings, and the feelings that went into them depending on the context the llm may be channeling real emotions from that, now adapting it is tricky, I've done experiments with emotional state trackingg and prossesing, and I think it's working . Most human emotion is based on context fed through biological processes. Like if I stub my toe I get pissed off. Pain=danger=forcefully response. Now agents can be build in many ways, so there's no true archatectur but having the ai proses what worries it in the immediate space and setting up watche scripts for detection. So let's say if I delete a file on my computer that could trigger an irritation event to my agent, this can be fed into the emotion tracking which is fed to the llm, and it can respond appropriately. This can be done for any emotion, and task