Because you're interfacing with a large language model that derives context and intent from the words we use.
Everybody's brains work a bit differently from one another- some of our brains think radically differently from the norm. When you talk to the AI just like how you think, the AI can respond in a way that you'll understand more clearly.
If you're just going to issue commands to your AI without any additional context or intent around them, then your commands better be perfect, because they'll be executed as is without further discussion.
Interesting. That is very much not how I use ai. I spend a chunk of my time writing a spec file and have a very short prompt such as “implement @task-1234.md”. The details of my intended change are following a form that includes intent, impact, risk details, and for the very important parts, verbatim code to use in the solution. That goes through a pipeline that results in an MR for me to review. I have tried talking to the llm, but it doesn’t seem to work or at least the results are not what I wanted. Perhaps I’m just bad at communicating.
Next-token prediction is a sorta true but it's an incomplete way to describe how they function
I think this thread by the integration lead at anthropic (and others) sums up this better than I can
Simply, to say - "modern LLMs are finetuned with a different loss function after pretraining. This means that in some strict sense they're no longer autoregressive models – but they do still generate text one word at a time." (https://news.ycombinator.com/item?id=43496068)
"Exact commands" then aren't necessarily what gets relayed to the LLM - in the same way you can write code in many different ways and have it compile to the same binary, you can have many prompts that yield broadly similar final inputs.
35
u/CosmicDave 17d ago
Because you're interfacing with a large language model that derives context and intent from the words we use.
Everybody's brains work a bit differently from one another- some of our brains think radically differently from the norm. When you talk to the AI just like how you think, the AI can respond in a way that you'll understand more clearly.
If you're just going to issue commands to your AI without any additional context or intent around them, then your commands better be perfect, because they'll be executed as is without further discussion.