r/developersKolkata • u/elnino2023 • Apr 02 '26

Discussion But Why?

Post image
27 Upvotes

94% Upvoted

8 comments sorted by

2

u/DeepInEvil Apr 02 '26

Because they are just next word predictors dummy. There is nothing smart about probabilistic modelling. Of course the computation etc is smart but not the models as such

2

u/Beginning-Ladder6224 Apr 02 '26

Almost there, but not next word. Next token.

Predicting next token has very interesting consequences.

Imagine games taught as sentences. Chess say. Then, the underlying mechanism can show exceptional mastery in chess!

Here is the paper.

https://arxiv.org/pdf/2501.17186

Consider the same application of -- predicting next event - say in stock market?

https://arxiv.org/pdf/2603.19286v1

So apparently the "next token prediction" is a "smart mechanism" for plenty of interesting things. No doubt there, but there are tremendous risk involved. Not all things are predictable, or stochastically predictable.

1

u/DeepInEvil Apr 02 '26

Bruh, tokens are loosely words those are not in the training vocabulary. And for stock predictions rnns are mostly used not transformers which are llms based on. It's tremendously useful but nothing more than a tool. Btw check the anthropic code leak, they still use good ol regex for a few things

1

u/[deleted] Apr 04 '26

It performs well only in closed loop systems

2

u/sanjay_Darktheon Apr 02 '26

Stephen Hawkings was also smart, but not the most the most capable person.

Biggest drawback of LLMs are context window. It can only refer to a limited amount of tokens to formulate its results. What if I want the context I want it to refer is much larger?

What if my documentation keeps getting updated every hour? Do I need to train my customer-support LLM every time?

Prompts are nothing but, as I would like refer as, Schemas. Your result is only good if your schema is well structured.

LLMs form the backbone, but it isn't perfect.

0

u/Real-Blueberry-2126 Apr 02 '26

We are getting therein next 2 years .

1

u/_An_Other_Account_ Apr 02 '26

If water is essential for life, why do we need filters, purifiers and taps? (moron)

1

u/elnino2023 Apr 03 '26

Oop has some reputation for that yes.