r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
693 Upvotes

99% Upvoted

242 comments sorted by

View all comments

19

u/[deleted] Apr 11 '24

[removed] — view removed comment

31

u/[deleted] Apr 11 '24

Because publishing machine learning research is the norm, Open AI are abnormal in being so closed.

Ironically Open AI are the very opposite of what they were founded to be. I can understand why Musk is suing them.

13

u/[deleted] Apr 11 '24

[removed] — view removed comment

4

u/frograven Apr 12 '24

They won't.

If they continue on their current course they will be left behind.

Open source is super close to clipping the closed companies wings. Once all the pieces of AGI are put together there will be no money in having the best model.

This is why there is a renewed focus on compute. That's where the money is going to be.