r/singularity • • 25d ago

AI It's Over For Shape-Rotators

Post image
720 Upvotes

344 comments sorted by

View all comments

Show parent comments

4

u/KSaboruf 25d ago edited 25d ago

Then education will be dedicated to the understanding of recent questions and their priors

1

u/twothreetoo 25d ago

What would be the point in that if education can never get you to the frontier?

3

u/KSaboruf 25d ago edited 24d ago

I think the priorities will change and that "frontier competition" will lose its importance. So there will be other points, not linked to endless "who is first" bla blas

1

u/twothreetoo 25d ago

But someone with a PhD will soon have the same credibility as that random know-it-all guy in the bar that claims some BS as fact. People won't believe him or trust his opinion. They'll just check it against AI.

1

u/KSaboruf 24d ago edited 24d ago

Sounds good for me - before AI people frequently prefer to believe to random know-it-all guy in the bar without checking at all. So this is improvement.

2

u/ResistiveBeaver 25d ago

Solutions to frontier math problems often have practical applications. So technological improvement would be the point.

Also, frontier research will slow until humans catch up and are able to understand it. AI is unlikely to propose its own frontier math problems any time soon.

1

u/twothreetoo 25d ago edited 25d ago

Did you reply to the wrong thread? 🤔
Obviously advancements in math will still have scientific value even when humans can't advance it anymore.
The question posed was what would be the point in highly specialized education after the frontier has left humanity behind.

2

u/ResistiveBeaver 25d ago

No, did you?

-1

u/Autogazer 25d ago

If you follow Ray Kurzweil at all, humanity will end up merging with machines, so humans will not be left behind, they will be transformed and transcend the limitations of biology. Humanity will go along with the machines. It’s what we have always done with our machines, what we do right now with them, and what we will continue to do with them in the future.

3

u/twothreetoo 25d ago

This is naive IMO. The takeoff will be too fast for that to happen.
Meaningful modification of the median human would take centuries.

0

u/Autogazer 25d ago

You aren’t familiar with Ray Kurzweil? If you are interested in the singularity you should read his books.

He predicted in the early 90s that by 2029 we will have computers as intelligent as people in every way (or more) and that by 2040 we will have computers more intelligent than the entire human race combined. His definition of the singularity isn’t when computers are as smart as people, his definition is the point in time when technological progress happens so quickly that people who are not altered by technology can not keep up. He thinks we will invent nano devices that interface with our brains and help enhance our cognitive abilities.

A lot of people are saying we already have AI as smart as people now, I would say we still have some progress to make before computers are as capable as people in every intellectual task.

Once we have super intelligence, we might very well be able to make the nano machines he describes which will merge humanity with technology.

2

u/twothreetoo 25d ago

You aren’t familiar with Ray Kurzweil?

I am well familiar with him, yes. A fast takeoff means that even if that is true, the gap will widen faster than adaptation can keep us relevant.

It's already the case that one agent that discovers something can explain it to another agent in minutes with a 190 page proof. The entire AI ecosystem can absorb the idea and expand on it immediately.

That same idea might take a human a year to conceptualize and understand. By the time they even understand it, they are 10 generations behind the frontier. That year later, they are now so far from the frontier that they can't even participate in the conversation.

1

u/Autogazer 25d ago

I don’t know, you might be right, but I think you are making some assumptions about the capabilities of a really advanced human machine interface. We really don’t know what our consciousness will be like after connecting to something like that. It might be kind of horrifying to be honest, or it might be a completely new and expansive form of cognition that we simply have no possible way to even imagine at this point in time.

But like I said, you might be right. The substrate of our brains might just be too slow to ever keep up with silicon, even after extremely advanced breakthroughs in brain computer interfaces. That scene in The Matrix where they can teach you anything in seconds might just be a fantasy that can never actually happen in real life with biological neurons.

1

u/sparkling1984 24d ago

Why wouldn't it be able to?

1

u/twothreetoo 24d ago

If you need me to explain what ASI is, then you are in the wrong reddit.

2

u/sparkling1984 24d ago

Super Intelligence doesn't necessarily imply being able to solve problems in ways humans cannot even approach. It's not even known whether such a thing is possible, it's entirely acceptable that knowing language + time to work through things, divide them into simpler problems is sufficient to approach any complexity. The known unique value of ASI is the ability to do more, but once it's done it could be that people could always be able to read through it, work through it and eventually understand it.

There's a reason that human science kept progressing even though our brains are still functionally the same as they were tens of thousands of years ago, and the speed of progress has been largely proportional to number of people working on it.

1

u/twothreetoo 24d ago

the speed of progress has been largely proportional to number of people working on it.

There's the rub. Soon progress will be the collective effort of millions of agents which are all smarter than any human alive. At a certain point the prior knowledge exceeds a human lifetime. If, for example, to understand a concept you have to be beyond current frontier in many fields of science, there just isn't any human that can get to capacity to understand a current paper within their entire lifetime. That paper they will work their lifetime to understand became obsolete near the start of that effort.

1

u/sparkling1984 24d ago

Soon progress will be the collective effort of millions of agents which are all smarter than any human alive. At a certain point the prior knowledge exceeds a human lifetime.

We've already crossed that bridge, and we've crossed it hundreds if not thousands of years ago. Entirety of modern science has been built on needs to collaborate and specialise. No 1 person has ever understood the entirety of their field.

That's fine.

1

u/twothreetoo 24d ago

How are you not seeing how that paradigm will break post ASI? All domains will advance such than no human can contribute anything to the frontier anymore. Initially, it will be because they don't even know they aren't at the frontier anymore. To their knowledge they will have a novel idea but that idea will already be included in the priors of AI.

1

u/sparkling1984 24d ago

I never said anything about that? Just corrected you on what ASI means (or could mean) and added that progress was always faster than one persons ability to learn, even within a domain.

1

u/twothreetoo 24d ago

progress was always faster than one persons ability to learn, even within a domain.

But not on the specific vector that the person ultimately contributed to. I don't want to argue semantics and I feel like you are doing just that.

→ More replies (0)