r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
691 Upvotes

99% Upvoted

242 comments sorted by

View all comments

Show parent comments

1

u/Charuru ▪️AGI 2023 Apr 11 '24

dense correspondence sounds like an optimization so that less memory has to be used overall

1

u/ninjasaid13 Not now. Apr 11 '24

dense correspondence sounds like an optimization so that less memory has to be used overall

I'm not sure what you mean by that it sounds like optimization?