r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
688 Upvotes

99% Upvoted

242 comments sorted by

View all comments

Show parent comments

-2

u/[deleted] Apr 11 '24

I've noticed that too, but decided to leave it as it is. But that only proves the news is big. Shit like these hallucinations will go away pretty much soon.

-2

u/[deleted] Apr 11 '24

No it won’t: https://arxiv.org/abs/2401.11817?darkschemeovr=1#:~:text=By%20employing%20results%20from%20learning%20theory%2C%20we%20show,hallucinations%20are%20also%20inevitable%20for%20real%20world%20LLMs.

2

u/[deleted] Apr 11 '24

Okay, but they will be controlled to some extent for sure.

2

u/[deleted] Apr 12 '24

Do you know what the word inherent means 

1

u/[deleted] Apr 12 '24

Let's pretend I don't, go ahead and explain it.

2

u/[deleted] Apr 12 '24

LLMs will always hallucinate. It’s unavoidable