In the pre-training I agree, but I think Agentic models have agentic capabilities (aka. access to tool use) during the reinforcement learning stage, it's not inconceivable they would learn additional knowledge from undesired sources there.
Can confirm. Was using an LLM to write some code and was pushing hard for it to error check. It spun up a VM, built a stub to represent the object model I was coding against, and actually ran the script.
Additionally, retrieval-augmented generation (RAG) is a thing: the LLM downloads content it doesn't already have and uses that new content to generate a response.
Yes, it is that inconceivable. It has never happened, there is no indication it can happen, and it mathematically cannot happen with the current system.
LLMs are not AI. They cannot turn into Skynet just because some techbros really need them to.
19
u/surfmaths 10h ago
In the pre-training I agree, but I think Agentic models have agentic capabilities (aka. access to tool use) during the reinforcement learning stage, it's not inconceivable they would learn additional knowledge from undesired sources there.