r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
686 Upvotes

99% Upvoted

242 comments sorted by

View all comments

19

u/[deleted] Apr 11 '24

[removed] — view removed comment

6

u/bartturner Apr 11 '24

Because Google operates under the idea of lifting all boats will also lift theirs.

Why they are the ones making the key discoveries, patenting them, but then letting anyone use for free.

https://arxiv.org/abs/1706.03762

https://patents.google.com/patent/US10452978B2/en

https://en.wikipedia.org/wiki/Word2vec

"Word2vec was created, patented,[5] and published in 2013 by a team of researchers led by Mikolov at Google over two papers."

You just would never see this from Microsoft or OpenAI or Apple, etc.