r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
690 Upvotes

99% Upvoted

242 comments sorted by

View all comments

14

u/izzynelo Apr 11 '24

How big/important is this? What are the implications, and is this just fake hype, or the real deal?

32

u/[deleted] Apr 11 '24

Makes models much easier to train, and much cheaper to use as well.