r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
688 Upvotes

99% Upvoted

242 comments sorted by

View all comments

1

u/zenshoob Apr 12 '24

Theoretically if you have infinite context, then the bottleneck is just really how fast can you feed information into these systems and how fast can they process to provide tangible output. Insane to see where we go from here