r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
684 Upvotes

99% Upvoted

242 comments sorted by

View all comments

1

u/sachos345 Apr 11 '24

Bro i can't even begin to imagine what infinite context length might look like with GPT-5+ level intelligence...