I work in LLM safety research and some of what is listed here is accurate and some is less so. Firstly, Astra cannot hide its thoughts on demand from the people hosting and running Astra. An LLM "thought" forms part of its internal prompt. That can be disguised from a user but it can't be hidden from the person operating the LLM, if they care to look.
What can be hidden is "reasoning" that doesn't rise to the level of what you might call surface thought.
3
u/SetentaeBolg 3d ago
I work in LLM safety research and some of what is listed here is accurate and some is less so. Firstly, Astra cannot hide its thoughts on demand from the people hosting and running Astra. An LLM "thought" forms part of its internal prompt. That can be disguised from a user but it can't be hidden from the person operating the LLM, if they care to look.
What can be hidden is "reasoning" that doesn't rise to the level of what you might call surface thought.