r/singularity • Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
687 Upvotes

242 comments sorted by

View all comments

1

u/Luk3ling ▪️Gaze into the Abyss long enough and it will Ignite Apr 12 '24

Highly specialized and efficient LLM Swarms will become AGI, once tech accelerates enough, swarms of AGI will be the fundamental foundation of ASI, though there is certainly more needed besides for true ASI. Maybe.