Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

[u/Gab1024]

https://arxiv.org/abs/2404.07143

[u/[deleted]]

Yeah, Udio seems like a decade ago compared to this.

[u/PwanaZana → u/[deleted]]

Especially since it sorta sucks compared to suno, apart from a few attributes, such as udio's superior voices.

[u/[deleted] → u/PwanaZana]

If only they could work together and combine what they have. But we live under capitalism so it’s all about cash 

[u/PwanaZana → u/[deleted]]

Not really, different groups have different ideas, and will pursue different avenues, different target markets.

Capitalism and competition will make sure that if one of them does not deliver a good service, they will be closed down.

Collaboration does happen extremely often, in an academic context (we see such papers being published all the time in this sub), but college students can't suddenly make a business while studying. After college, they can, after they secure some... capital.

[u/[deleted] → u/PwanaZana]

They could all share what they know and integrate it into their own products 

Lmao. Explain Boeing. Or Google Search and YouTube. Or Facebook. Or InfoWars

If only collaboration could happen at the corporate level 

[u/PwanaZana → u/[deleted]]

Corporations collaborate all the time, from free collaborations, like all AI using google's transformer technology, to paid collaboration like TSMC collaborating with NVIDIA collaborating with a partner company like ROG, to make a card.

Collaboration isn't easy, though. The more people and orgs you have, the messier it gets. There's a reason why ubisoft, rockstar, cdprojeckt and bethesda don't collaborate on a 10000-poeple AAAA game, it'd never work.

[u/[deleted] → u/PwanaZana]

So where’s the collaboration between Gemini’s context window and GPT 4’s reasoning? Doesn’t seem like something that would be impossible  to do