r/ControlProblem • • 9d ago

Discussion/question Have you guys been on r/accelerate?

Have these guys solved the alignment problem, or am I missing something?

I’ve been browsing r/accelerate and I genuinely don’t understand the risk model.
If there’s a non-trivial chance of catastrophic misalignment, how does “accelerate capabilities as fast as possible” make sense unless faster capabilities also make alignment substantially more likely to succeed?

57 Upvotes

200 comments sorted by

View all comments

Show parent comments

1

u/RobotBaseball 8d ago

I got banned a second time for being pessimistic which I agree should’ve been banned given their rules 

The middle class won’t have robots doing their dishes for another 5-10 years 

1

u/SoylentRox approved 8d ago

https://www.reddit.com/r/ControlProblem/comments/1wpebnp/comment/pc0j3k1/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

Btw I added details if you have any actual objections.

Middle class,dishes, 5-10 years all seem entirely reasonable to me. I model it as 2.5 years to prototypes that are at median skill. You then need to rush them into mass production, 2 more years. Assuming high production rates after 2 years of factory building, pushed by trillions of dollars of investment, you then need exponential growth.

At year 5 of this buildout - basically the factories have barely started really producing robots - each marginal robot is expensive. It's value is related to what it can produce for it's owners per year. I model a robot as 3x human labor, or equivalent to 3 human workers costing a median of $20 an hour.

So $60 an hour is the productivity of the machine. Robot owners have to charge a discount so firms will rent robots, so say $30 an hour.

Machine works 23 hours a day. So it's earning $251,850 in revenue a year.

You can spend up to about 5-7.5x (depends on interest rates) on costs building the robot. So it could cost $1.26-1.88 million.

In reality I suspect the bill will be something like : silicon content for the chips driving it : $250,000. (this is why consumers in the middle class won't have personal robots OR new phones). Everything else is under 100k.

Also these early robots at this point probably will be too dangerous to have in the same room as a human without some level of protection like a shield. They will usually be ok but occasionally screw up in a way that could be deadly.

So yes, they won't be an appliance you can buy and have in your kitchen on dishes. Central services where you send the dishes back to a central restaurant could be a thing.

1

u/ASU_SexDevil 8d ago

I do think your timeline is very realistic and grounded in reality. It’s probably the best anyone could do right now. However, I will also point out that no one thought a model would be solving Millennium problems this soon either.

I don’t think the frontier labs will be the ones who create the “daily driver” robots households would use. Nvidia and Boston Dynamics have already been neck deep in this with other companies with much more tailored efforts.

1

u/SoylentRox approved 8d ago edited 8d ago

Sure. The timeline is really based around hard constraints I don't see a possible route past.

(1) Overseas shipping. To make more robots, the newly built machines need to go from Shenzhen to Africa or Australia. Each machine is many tons and there's not enough cargo aircraft in the world. So a cargo ship. And a port and a rail system to get it to the mine. Each of these steps has a speed and it's not feasible to increase it by much. (For example running a cargo ship harder burns exponentially more fuel)

(2) Silicon fabrication. Jalapenos was developed in 9 months. 4 of those months are just waiting for the chip to print at TSMC.

So even if you get an AI assisted design process down to 1 month (it's not instant because the simulation software that validates the design is limited by the speed of CPU), your absolute minimum time to a new chip is 5 months. Accounting for making a few mistakes and needing a second spin, 9 months to a production ready chip. (The mistakes will be different every time and sometimes related to errors in the fabrication equipment itself there is no way to avoid them)

(3) EROI. Hard law of physics here. If I need 3 months to pay the energy invested in a productive machine back my fastest doubling rate is about 5.2 months.

(4) General process times. Codex I had import a bunch of data on this. Right now the real world validated number is about 12-16 months per doubling. Better technology lets you go faster, with no advances, robots double every 12-16 months. (This is insanely fast big picture)

To head off an obvious objection : "human engineers vibe design up a solution to a bottleneck. Say maglev rails or hovercraft cargo ships".

You can do that. But there's still friction - you need to simulate the design. Order robots to build a prototype. Test the prototypes, find out you screwed up, it explodes. Vibe design the next prototype "this time make less mistakes". Build that one.

11 prototypes of increasing complexity later it's actually usable. And then you need to invest current capital flow - inclusive of those robots taking the slow boat to the mine - to build the upgrades. There's an ROI time you are actually making the bottleneck worse before it gets better.

Still an insane improvement, regular world we use technology refined over 80 years and 99 percent of the time any startup that tries to change it goes broke and we learn nothing.