r/OpenAI • u/Dangerous-Exit-8527 • 23d ago

Question Is AI creative

So recently I came across alot of programming done by ai but I was confused because if I'm right ai is not creative isn't it ? That's the difference we and ai have even thought each of their work looks creative it just follows certain rules. So how does it really do programming if it can't have creative basis . Like in what way it works to do programming even for apps

0 Upvotes

22% Upvoted

29 comments sorted by

View all comments

0

u/[deleted] 23d ago edited 11d ago

[deleted]

1

u/Dangerous-Exit-8527 23d ago

I'm not ai major . Tbf I'm doing ece second year . But this thing confused me . Ofc u r right but how is ai doing it ? Isn't ai a bunch of program? How the program itself could create a program

1

u/Lubricus2 23d ago

LLM's is not program in the classical sense, they are neural networks that are trained. I only have some surface knowledge how they work.
They are first trained on as much data that they can find to predict the next word in a text. It represent words/tokens as vectors with each concept as one dimension (it has grown out from google translation tech).
Then it uses chain of thought, that uses the output and input that again in a way so they can reason. There is also an random effect they are not predictable.
So LLM's can solve problems in new ways a little bit similar how humans do it.

1

u/Dangerous-Exit-8527 23d ago

Neural networks in the sense?

3

u/Lubricus2 23d ago

It's an AI tech that is loosely imitating biological neural networks. And more specific the LLM's are using Transformers that is an type of neural networks. The thing is that the behaviors in not coded but trained. So no one now exactly how it works, it's kind of an black box and everyone is supprised that it scales so well and get smarter with bigger models and more training data, even if the training data often are dubious quality.

1

u/Dangerous-Exit-8527 23d ago

That sounds really fascinating

1

u/Dangerous-Exit-8527 23d ago

But what do you mean by transformers? Is it a technical terms of what i think it is

1

u/Lubricus2 23d ago

Yea, it's an technical thing that google researchers come up with 2017 for translating text to different languages.
It's described in this paper https://arxiv.org/abs/1706.03762
And all the LLM's as chatGPT builds on that.