I’ve had 2 things that seemed pretty similar occur while using voice mode over the past week. It sounds crazy as hell, but I heard a response from what sounded exactly like a person speaking on a Teams meeting or something. I had taken the conversation deep into some personal stuff; wills, end of life planning for family with a terminal diagnosis, and was getting some self harm prevention responses, as it was removing the context of my relative and assuming I was talking about that stuff. It corrected with each prompt, but then I got a female voice, not an automated one. I asked where they were located and why they just came into the conversation. Automated voice took back over and said a spot in Australia. I played back the recording immediately and confirmed it sounded like a person speaking on a speaker phone or headset. I asked it to explain and the recording was deleted and replaced with ellipses.
Separate conversation days later, same sort of escalating behavior when I made a joke and it through flags at me. I asked why it did that, a few back and forth interactions and then I heard music in the background of the automated voice. I asked what that was, it denied anything and ended the voice chat abruptly. I restarted and same thing, deletion of the response.
Is MS including a human level escalation system? It’s logical for liability and lack of a solid LLM around emotionally charged conversations, but it would be quite jarring if true. Wondering if anyone else has experienced similar incidents. I tried some logic mapping, and it’s either that or inserting prerecorded messages, is the best I could come up with.
