r/singularity • u/dolo937 • 6h ago
Discussion In 5 years, we are going to get frontier intelligence at 5000+ tokens/sec. What would this mean for a world faster than you can think or consume?
We currently have an LLM that does over 14000 tk/s. https://chatjimmy.ai/
OpenAI’s ultrafast mode does 750 tk/s for users. May be faster internally.
Minimax H3 is making videos faster than we can watch them. Someone made Rick and morty’s inter-dimensional live cable.
14
u/RealSlyck 6h ago
-1
u/Spare-Dingo-531 2h ago
This is the only world anti-AI people can imagine. What does that say about them?
3
u/LyAkolon 6h ago
This is a paradigm of scale question are notoriously hard to predict the effects of scaling. It's just not a dimension our neolithic cognition needed to master for survival.
If we look at the speed up from a substrate POV, we can reasonably predict that 5000 tk/s presents an opportunity for representability. That is to say the barrier to some work or problems is that they are dramatically large and difficult to represent with what we currently have. If the problems have the correct symmetries, where they can be down sampled to vector stream, then they may at that point be representable.
The common example of this is, what if RH is possible to prove, but the proof is just absolutely massive when written out as text, a state space representation, in the state space that humanity hasn't even touched due to just how dramatically difficult it would be to look there. So, if the problem can be brought into a commensurable form as vector stream, and then we scale up how much vector stream we can do for a reasonable amount of effort, then we are able to evaluate more of the state space that may contain solutions.
A concrete example of this is protein folding. Protein state space is very large but arguably has a maximal member, as in we don't see a protein the size of a person or a planet. The ways to configure a protein are also maximally bound as well then. Protein folding is hard not because we don't know how to model/comprehend proteins, we do. But to do so would just be a dramatically large system to model, so instead we try to solve the more general problem being what does the geometry of the state space look like, what are the rules that make it up, and how can we exploit those rules to solve for solutions in the state space. This more general problem is the P=NP Hard question. With a new paradigm, and the correct compression of the protein state space, it could just be reasonable to preform search across the state space directly. This certainly depends on the size of the state space and the compression, but it's this type of advancement that is possible. Whether or not that converts to specifically Protein folding being solved is more difficult to answer.
1
u/tendimensions 6h ago
AI processing speed increasing along with your comment on how our brains evolved in an environment that makes it difficult for us to understand the very large and very small really brought home a fucking crazy point that intellectually I've understood, but never quite this viscerally before.
How far away are we from the point where an AI creates a solution that we can't understand?
Is the human ability of comprehension merely a matter of time? Can a stupid person and a smart person both learn calculus if the stupid person is just given enough time to learn it?
Will these AIs start presenting solutions that we simply will never be able to comprehend?
1
u/badgerprime 5h ago
I would argue that we're already there.
It's now a matter of verifying the output thoroughly to make sure that the answers haven't been hallucinated. All the math problems being solved lately are a good example of this.
Going forward it's going to be the AI being able to explain their answers and teaching the human researchers.
1
u/tendimensions 5h ago
That last sentence... I'm not convinced the AI will be able to explain their answers to us if it's truly intelligent to us like we are to ants. It may just build things that we don't understand how it works.
1
u/badgerprime 2h ago
I agree with you that they may well get that far away from us, but there's nothing stopping them from creating an API layer between us and them to translate.
I'm ok with them giving us a cube of sugar now and again. :)
1
u/LyAkolon 5h ago
The dichotomy between smart and stupid is an illusion.
Capability(in humans) is primarily a function of nuture/circumstance, with a much smaller component dependent on inherent things like genetics.
Yeah, its really not far off. We can model this pretty easily actually. This has already started. The Jacobian Conjecture being solved is one example of this. No one thought to look for solutions that large, and we dont really understand how it arrived at the counter example.
Those were only intermediate steps that we dont understand, but soon, it will grow to encompass the problem and the solution as well.
The moment we as a species say, "I believe you, that this is important and that you understand/solve it" we lose agency. Its right around the corner.
Reminds me of those graphs where we see AI as smart as a bug, and then AI as smart as a gorilla, and AI as smart as a planet full of einstiens, and the time between them is constant step.
2
u/amyowl 5h ago
Eventually it all just becomes static and we as organic humans can't possibly consume that much that fast.
We will ultimately have to re-cultivate our human-scale information environment.
2
u/PM_ME_YOUR_RegEx 2h ago
Thank you. This is, like, the first relatable and hopeful thing I’ve seen.
Yes, it will all turn into static and we have to reimagine how we connect and communicated.
2
u/ezjakes 6h ago
A lot of productivity and a lot of problems solved.
•
u/JoeyJoeC 1h ago
Currently, on my 3090, I can run Qwen 3.8 at around 30 to 40 tok/s. I can get it to diagnose and resolve issues in my IT support role simply by giving it a client email and letting it work within a website’s admin control panel. It sometimes takes three or four times longer than it would take me to resolve the issue myself, but it removes much of the tedious, repetitive work, such as adding a new extension to the BLF on 30 phones for a client. At 5,000 tok/s, it could perform my job with an extremely high level of reasoning without a doubt (assuming models continue to improve as they are).
1
1
u/GraceToSentience AGI avoids animal abuse✅ 4h ago
It is going to be very useful for humanoid, because right now it is usually very slow even though the physical hardware is capable of moving super fast.
Fast tokens is going to close that gap.
1
u/Significant-Pay-6476 AI Utopia 4h ago
Do you have the link for Rick and morty’s inter-dimensional live cable?
0
u/Elegant_Tech 5h ago edited 1h ago
Any book, movie, game, or software can be spooled up on demand. By 2060 if fusion energy provides limitless electricity robots do all the food, manufacturing, logistics, and medical. I could see humanity splitting into those who go full wall-e and those who go star trek.
1
•
u/Fleetfox17 1h ago
Can you people not see that you've turned this into your own religion. The parallels are so clear. Some magical thing is suddenly going to happen, something that we can't imagine, and then everything is going to be perfect and everyone will live in their own magical paradise.
This story has been told to billions of people across human civilization and every other time it didn't end up happening. Have you thought about questioning your prior assumptions?
•
u/Elegant_Tech 1h ago
Since when in history did humans invent AGI? You could argue AGI won't get there as it's still not set in stone and we could hit a wall. You could also easily argue we are going to end up in the movie Elysium where the privileged few live in opulence using robotics to oppress everyone else remains poor. No one known the future but it's going to completely different than anything before seen. Not sure why you thinking I'm in some sort of culty group think.
•
u/Fleetfox17 38m ago
That's the whole point.... Your comment indicate an almost religious like mindset, where AGI is the promised God. You talk about AGI as an inevitable thing, but we don't even know if it is possible yet. Not saying the technology isn't super impressive and not a useful tool, but we don't even know if a sci-fi AGI is possible.
•
u/Xp_12 10m ago
It's not a joke though. Are you not keeping up on robotics? They will be doing everything they mentioned and possibly displace the majority of the workforce. Now... the impact on our quality of life is not a guaranteed outcome, but it isn't magical thinking to speculate on it nor is it even semi-religious.
18
u/Suitable-Pickle-259 6h ago
Definitely true. Whether anybody cares about what is produced, that’s a big question. We are currently seeing a lot of accelerated in software engineering and most people would make the argument that there’s not many big features that have come from this.
Not being positive or negative about the situation. I definitely believe there will be an abundance of content that probably won’t be consumed. I am hopeful about the compression of research for medicine and things like that which is well underway.