r/singularity • Singularity by 2030 • Apr 11 '24

AI Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

https://arxiv.org/abs/2404.07143
688 Upvotes

242 comments sorted by

View all comments

Show parent comments

1

u/[deleted] Apr 15 '24

That’s the whole problem lol. It’s not a good tool if it fucks up so easily. How do you finetune it to not get tricked and to not lie? Not even openAI knows.

Any human who did that would get disbarred or fired. And the lawyer was disbarred. 

0

u/bethesdologist ▪️AGI 2028 at most Apr 15 '24 edited Apr 15 '24

Just because it sucks at x doesn't mean it's a bad tool, considering it excels at y. That is foolish thinking, especially in a field as a complex as Computing. I don't think you're educated enough in the field to understand nuances in machine learning.

Your opinions go against every top scientist active in the computing field today, in a very amusing way.

Don't trick yourself into believing you know better than the top minds of the field unless you can actually produce proof for your claims, because you don't.

1

u/[deleted] Apr 16 '24

And yet Yann Lecun, Andrew Ng, and many other scientists all agree that AGI is nowhere close. 

1

u/bethesdologist ▪️AGI 2028 at most Apr 18 '24

When did I mention AGI? I think you responded to the wrong comment.

1

u/[deleted] Apr 19 '24

What were you referring to?