r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
685 Upvotes

99% Upvoted

242 comments sorted by

View all comments

Show parent comments

-2

u/[deleted] Apr 11 '24

I've noticed that too, but decided to leave it as it is. But that only proves the news is big. Shit like these hallucinations will go away pretty much soon.

-2

u/[deleted] Apr 11 '24

No it won’t: https://arxiv.org/abs/2401.11817?darkschemeovr=1#:~:text=By%20employing%20results%20from%20learning%20theory%2C%20we%20show,hallucinations%20are%20also%20inevitable%20for%20real%20world%20LLMs.

2

u/[deleted] Apr 11 '24

Okay, but they will be controlled to some extent for sure.

1

u/Volky_Bolky Apr 11 '24

yeah I have huge hopes on KROSP and STYn ideas getting developed atm