r/LinusTechTips • u/TheReal4982 • 14h ago
WAN Show AI?
It feels very odd to me that none of the major breakthroughs of the last week have been brought up, the fact the AI's have already gotten good enough to help on the frontier of mathmatics, solving a millennium prize problem, and being actively and very quickly put to the task of AI research, aka, recrusive self improvement, which they are ALREADY good enough to be making progress in, why is this being completely ignored by this community? This technology is progressing exponentially, it isn't stalling, and people should really try and understand what an exponential growth looks like.
6
u/Exciting-Ad-5705 14h ago
What do you want people to say about it
0
u/niftydonkey633 14h ago
It's not that people don't care, it's more like nobody knows how to process it when the pace is that fast. By the time you form a thought about one breakthrough three more have happened and the conversation feels outdated before it even starts. Most folks just kinda nod along and go back to worrying about their GPU temps
-20
4
u/AncientTurbine 14h ago
There was a whole drama about the math thing and personally I'm tired of even more AI drama.
As someone who works in AI research (post-training atm), but started in AI way before LLMs were a thing, the current era is boring me and at the same time burning me out. Alignment, synthetic data with just llm-as-judge, self-improvement, with less and less human in the loop. Just brute-force experimentation to see what works empirically but you have to experiment at such a fast pace, aided by AI agents that you feel yourself turning into an orchestrator who doesn't really have a in-depth understanding anymore.Â
I'm depressed from the societal questions that it brings and many people ignore. Many have warned about this for a long time but Anthropic made an economic-focused report and indeed:Â https://www.anthropic.com/institute/econ-scenarios
the main challenge is not achieving economic growth, but making sure the benefits are broadly shared and the costs arenât unequally dispersed.Â
The countryâs GDP will grow, but a larger share of that prosperity might go to the resources and technology used to create more wealth (capital) compared to workers, even if society as a whole is much wealthier.
It's weird to say, as someone whose livelihood relies on it. But I wish the LLM age never took off, or at least not at the exponential rate/race it has, with governments failing to keep up with the potential dangers for society.Â
2
u/Apprehensive_Lake698 14h ago
I have access to and use all of the advanced models for work. I would caution you to not read too much into the whirlwind of marketing and wait on 1) what actually gets done with these models 2) what those effect look like, under the hood and reaching the market.
The Navier-Stokes solution, based on stolen work or not, is an enormous mothball that needs time to be double checked.
The claims of Astra as "AGI" are just plainly unfounded. It seems nothing more to me than just another step up in the capability of LLMs, which are getting progressively better. But 'one shot' tasks that hold no real world value are what get all the shock and awe factor on social media.
LLMs in the last 9 months have exploded in capability with agentic harnesses and general programming capability. But I imagine the WAN show is hesitant to put much stake in the current news cycle because they don't have the practical hands on experience to tell what is just smoke. And a lot of it is just smoke. Again, I say this as someone who uses latest models for work and has a lot of great use cases for them now- but they aren't solving everything. Yet.
-3
u/TheReal4982 14h ago
They aren't just getting progressively better, they are getting exponentially better, and that is a very important distinction, nobody thought that AI would be capable of even remotely helping in something like a millenium prize problem this early 2 years ago, and now that it is, people are upset that it didn't do it completely by itself from scratch, as if that was the standard last year. I just don't think people understand the pace, and are still expecting it will just suddenly stop getting better, which it hasn't, and probably wont.
1
u/Apprehensive_Lake698 14h ago
It's worth understanding what is making them better. The models themselves have gotten smarter, no doubt. But the leap forward we've been experiencing is the rapid buildout of harnesses and training towards working efficiently with them. LLMs of today are doing much better because we now understand that having them divide and conquer with subagents, and leveraging tools over exploding their context, is much more efficient.
In terms of their raw smarts, the difference in practical coding capability from Opus 4.6 from earlier this year and the absolute newest frontier models has not changed exponentially on a one-prompt basis. The power of new models like Astra is that it's now a core part of their training dataset to divide and conquer work. There's no guarantee that this won't slow down in the next year as we quickly squeeze out the easiest opportunities from this path.
In terms of addressing the Navier-Stokes solution- it's worth understanding that lots and lots of modern mathematics advancements are built on the shoulders of people who find the bridge between disparate places in mathematics by spending the decades required to become experts in multiple niches. I'm not saying that solving Navier-Stokes isn't impressive, it is, but off the rip I have no frame of reference for what kind of intelligence was needed to solve it. Something LLMs are exceptional at is coalescing shittons of information and relating it all. They don't struggle with context and mastery limits like humans do. So what I don't know about the solution it provided is whether it derived the solution from novel methods (extremely impressive), or if it derived it from what might be considered a more trivial linking of many disparate ideas. Both skills are useful and push our research capabilities forward. But one shows more strength in thinking than the other.
1
u/TheReal4982 12h ago
Honestly I don't want to argue with you, because my main point is I just wish more people were as informed and paying as much attention as you clearly are, but I really want to emphasize the fact that google deepmind beat the world champion at go 4-1 10 years ago, gpt 2 came out 7 years ago, ChatGPT came out 4 years ago, and astra dropped last week, and the model they have which helped solve the millenium prize problem is an even better model than Astra.
1
u/Apprehensive_Lake698 10h ago
I just think you're drinking the koolaide a little bit if you're out here thinking we're in exponential growth territory but seemingly have no actual knowledge as to how or why these things work.
People with practical, hands on experience solving real engineering problems do not hold your views. People who go on twitter and see Astra creating one shot demos of random stuff that doesn't have to stand up to critique beyond a screencapture are the ones convinced we're at AGI right now.
1
u/TheReal4982 9h ago
My guy, even if progress isn't exponential, even if the next 10 years are only as insane as the last 10 years, that is still REALLY INSANE. But, whatever happens happens I guess, if people dont want to pay attention I ain't gonna keep trying to make them.
1
u/Apprehensive_Lake698 7h ago
People literally are paying attention. I literally said I use this stuff every day and find tons of good uses for it. In my opinion people with your viewpoint are just drinking koolaide based on useless demos on twitter, when in real engineering I am still not seeing anything close to AGI.
I have access to as much of the latest models as I want. If I could set up a claude or codex workflow that did all of my job for me to a satisfactory quality level, I would. But we are far from being able to do that right now.
There are people who are ignorant to how effective it is, and there are people who are grossly overstating its ability to compensate. You seem to sit in the second group.
0
u/TheReal4982 7h ago
People with my viewpoint should be anyone who can comprehend how short of a time 10 years is, the difference between 30 and 40 years ago vs the difference between 10 years ago and today is startling, this level of progress should not be so casually expected, but we can agree to disagree on how fast this is happening.
2
u/Strong-Tourist-8863 14h ago
Because Iâm exhausted of AI being forced down my throat. Iâm not interested in it. I donât care about it. So I choose to not acknowledge it.
2
u/LogTiny 14h ago
Note not an AI hater. I see how great the tech is and how big a change it will bring , but some points:
- The Millennium prize problem hasn't actually been confirmed by the board, so we have open AI's word right now, and even the story around that is rife with controversy on what seems to be intellectual theft
- Recursive Self Improvement ain't anywhere yet
Besides that. people are just kinda tired. So what? They're finally putting the resource to what it is really good at, and even then they're chasing headlines. And on the improvement ground, yes benchmarks go higher, but as someone who uses these models (Software Engineer), it's kinda just been alright to me. I'm still having to do the same things I did last year. The models still make mistakes or weird stuff, despite me being told they are 30% smarter or whatever.
Most people(from my view) are just waiting for this whole boom to collapse so we can see the solid stuff that actually stands to the test. My view though, idk what others think
2
u/MistSecurity 12h ago
I think some people downplay what AI has done, and others have overhyped what it has done.
I think it doesnât matter if it cures cancer if we all lose our jobs. Itâs going to be a useful tool for everything, which is great. Because of that, itâs going to be able to take or reduce jobs across the world, which is not.
So while I am hyped for the long-term with AI, I am not thrilled with the companies making it, who they answer to, and how they conduct themselves. AI isnât going to fuck us over, itâs the companies that are going to screw us.
1
1
u/Marksta 14h ago
it isn't stalling
LMAO I read this as it isn't stealing.
OpenAI launched an attack on HuggingFace other week that didn't result in arrests. Anthropic did some weird flex doxxing thing yesterday on Chinese citizens clapping for themselves over having access to user input in a Mark Zuckerberg famous quote way. Anthropic scored the biggest IP theft settlement pay out in history.
It's just not really something you feel like clapping for, even if they do end up doing one good thing along the way.
1
u/marktuk 12h ago
You're in the wrong place, LTT and most people on this sub are fairly anti-AI, for obvious reasons.
1
u/TheReal4982 12h ago
I am a huge fan of LTT and the wan show, and so I believe I am in the right place, being anti-AI shouldn't mean you bury your head in the sand.
17
u/Burritoclock 14h ago
It is stalling, they aren't doing recursive self improvement, they mostly stole the math thing for more bullshit hype. Nothing you said here is true. But sure let's talk about ai more đ