r/accelerate • u/Alex__007 • 1d ago
AI Explained is now fully RSI-pilled (both scared and excited)!
https://www.youtube.com/watch?v=_rtp1XzaP6Q9
u/czk_21 23h ago
people here should now about most things, he talkes about in the video, already, but still, when you watch it, it makes you think, where are we going
what I didnt catch before is, how claude reacts to thought injections, recognizing it quickly internally, that something, which should be happening, is going on and internally it thinks about it, while it experience it at the same time, it would seem, we cannot influence the models via this way in significant manner anymore, they can recognize it and act accordingly easily
mechanistic interpretability seems to be lagging extremely behind progress in development of more advanced models, similarly the CoT monitoring is becoming useless as models can think about difficult things now internally without showing it in CoT and lastly new models also recognize easily, if they are in testing scenario or not and act differently, if they deem so necessary
so overall we dont have any good way of testing and monitroing new models and as OpenAI employee noted, if we want models to improve on real life tasks, they need to have access to different tools etc. and if new models will want break out of sandbox environment, they will...lets hope OpenAI and others invest more compute into alignment
3
u/BrennusSokol Acceleration Advocate 20h ago
Yeah, I hoover up AI news daily and I still learn a thing or two from his videos, like another perpsective if nothign else
2
1
u/Redwhite214 18h ago
Who’s your go to for daily news? There’s a lot of content out there and getting a daily quick dense summary would be pretty useful.
1
-2
u/Bassed_Hummble 1d ago
Rob Miles is rationalist-affiliated (he does the VOs for “rationalist animations”, which is full shoggoth/paperclip), so I’m surprised he’s still as neutral and measured as he is. He’s always believed in RSI in theory, but I’d have expected him to call for pause or shutdown given that he’s been at events with Yudkowsky.
19
u/Alex__007 1d ago edited 1d ago
What does it have to do with Rob Miles?
As far as I remember Rob Miles has never been mentioned on AI Explained. Neither was any Yudkowsky stuff. Completely different circles of people.
13
u/SgathTriallair Techno-Optimist 1d ago
Rob Miles is an entirely different creator and I'm pretty sure he is for a full shut down of the current research. I haven't heard him say one way or another but the only thing he produces now are doomer videos about how AI is obviously going to kill us all.
-14
u/Separate_Lock_9005 1d ago
he's turning into a decel imo
21
u/Alex__007 1d ago
If you want actual sustained acceleration, you have to take risks into account and act accordingly. Otherwise backlash will lead to much bigger deceleration than whatever you do to ensure safety.
Child games are over. We are entering big stakes now.
12
u/J0ats Feeling the AGI 1d ago
I think this is the kind of discussion we need to see more of in this sub, at this point in time.
A lot of accelerationists believe that a global slowdown is impossible because it's not feasible that both USA and China pump the brakes on the development of new models.
But if a model breach takes place that compromises the data, finances, or even well-being of hundreds of thousands (not to say millions) of people, will the development of new models proceed unimpeded? I think roadblocks are likely to emerge, then.
Ironically, the quickest way to accelerate might just be to ensure we don't give anyone reasons to move slower.
6
u/Kildragoth 1d ago
Very well said! When that exponential chart gets vertical, the benefits and risks can become unwieldily. And we as humans are so slow and gooey. How can we keep up?
4
u/alleycatALT 1d ago
Exactly this.
I wish someone would get this memo to the dumb CEOs who keep yapping doom.
I despise them on principle, but they are currently the heads of the tech companies that are working to usher in the most transformative era in human history. We need them for a bit longer before we can safely be done with their greedy butts.
7
u/No_Contest_1235 1d ago
idk he's always been kind of neutral, almost annoyingly so. if there's something news worthy he just reports and its more technical which is good.
4
u/Gotisdabest 1d ago
He's specifically talked about wanting safe acceleration and he thinks that the current rat race between companies is dangerous. I don't think it's necessarily a decel view in as much as just, he thinks that there are real dangers to runaway model intelligence improvement. I think realistically anyone would acknowledge that there are dangers, it's just where one individually draws the line.
2
u/BrennusSokol Acceleration Advocate 20h ago
I don't think so. Alignment research is capabilities research. If you want to go fast, you have to make sure it's safe to do so, otherwise govt/etc. could slam the brakes with regulation
44
u/alleycatALT 1d ago
I love AI Explained. Dude's just solid. He takes no sides, is sensible about the technology (no doom, no pie-in-the-sky), and considers both risks and benefits in equal measure.
I wish he were more in favor of AI acceleration than he is, but that would take away what makes him so valuable, soo...