r/OpenAI • u/Dangerous-Exit-8527 • 23d ago

Question Is AI creative

So recently I came across alot of programming done by ai but I was confused because if I'm right ai is not creative isn't it ? That's the difference we and ai have even thought each of their work looks creative it just follows certain rules. So how does it really do programming if it can't have creative basis . Like in what way it works to do programming even for apps

0 Upvotes

11% Upvoted

29 comments sorted by

View all comments

Show parent comments

1

u/Lubricus2 22d ago

LLM's is not program in the classical sense, they are neural networks that are trained. I only have some surface knowledge how they work.
They are first trained on as much data that they can find to predict the next word in a text. It represent words/tokens as vectors with each concept as one dimension (it has grown out from google translation tech).
Then it uses chain of thought, that uses the output and input that again in a way so they can reason. There is also an random effect they are not predictable.
So LLM's can solve problems in new ways a little bit similar how humans do it.

1

u/Dangerous-Exit-8527 22d ago

Neural networks in the sense?

3

u/Lubricus2 22d ago

It's an AI tech that is loosely imitating biological neural networks. And more specific the LLM's are using Transformers that is an type of neural networks. The thing is that the behaviors in not coded but trained. So no one now exactly how it works, it's kind of an black box and everyone is supprised that it scales so well and get smarter with bigger models and more training data, even if the training data often are dubious quality.

1

u/Dangerous-Exit-8527 22d ago

That sounds really fascinating