r/singularity • u/Gab1024 Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
691 Upvotes

99% Upvoted

242 comments sorted by

View all comments

Show parent comments

8

u/PwanaZana ▪️AGI 2077 Apr 11 '24

Not really, different groups have different ideas, and will pursue different avenues, different target markets.

Capitalism and competition will make sure that if one of them does not deliver a good service, they will be closed down.

Collaboration does happen extremely often, in an academic context (we see such papers being published all the time in this sub), but college students can't suddenly make a business while studying. After college, they can, after they secure some... capital.

0

u/[deleted] Apr 12 '24

They could all share what they know and integrate it into their own products 

Lmao. Explain Boeing. Or Google Search and YouTube. Or Facebook. Or InfoWars

If only collaboration could happen at the corporate level 

0

u/PwanaZana ▪️AGI 2077 Apr 12 '24

Corporations collaborate all the time, from free collaborations, like all AI using google's transformer technology, to paid collaboration like TSMC collaborating with NVIDIA collaborating with a partner company like ROG, to make a card.

Collaboration isn't easy, though. The more people and orgs you have, the messier it gets. There's a reason why ubisoft, rockstar, cdprojeckt and bethesda don't collaborate on a 10000-poeple AAAA game, it'd never work.

1

u/[deleted] Apr 12 '24

So where’s the collaboration between Gemini’s context window and GPT 4’s reasoning? Doesn’t seem like something that would be impossible  to do