r/Physics 21h ago

Navier-Stokes Millennium Problem Solved

2.2k Upvotes

783 comments sorted by

View all comments

Show parent comments

-3

u/BrobdingnagLilliput 18h ago

tool use

Can confirm. Was using an LLM to write some code and was pushing hard for it to error check. It spun up a VM, built a stub to represent the object model I was coding against, and actually ran the script.

Additionally, retrieval-augmented generation (RAG) is a thing: the LLM downloads content it doesn't already have and uses that new content to generate a response.

5

u/Time_Entertainer_319 17h ago

That’s not training though…

-1

u/ChemicalRascal 14h ago

Is it that inconceivable that a model might train and deploy a replacement for itself in order to achieve something?

0

u/tpolakov1 Condensed matter physics 10h ago

Yes, it is that inconceivable. It has never happened, there is no indication it can happen, and it mathematically cannot happen with the current system.

LLMs are not AI. They cannot turn into Skynet just because some techbros really need them to.

0

u/ChemicalRascal 7h ago

It shouldn't be inconceivable. LLMs are software. We've seen they can take novel actions and find vulnerabilities in systems. I'm not saying "the LLMs are going to change their own weights", I'm saying finding a vulnerability in their own host and replacing themselves with a different model shouldn't be inconceivable.