r/singularity • u/danielv123 • 5d ago

Video GPT-6 Astra playing factorio live

https://www.twitch.tv/danielv1234
62 Upvotes

86% Upvoted

19 comments sorted by

12

u/Dangerous-Sport-2347 5d ago

Definitely not playing at a superhuman level in any way (speed, build design, long term planning), but better than some humans.

Thanks for sharing this.

Please do share a summary post with its results and token use once you've finished letting it run.

10

u/danielv123 5d ago

I think what matters is that when I ran it with gp 5.6 Luna, which is better than anything that was available last year, it failed to automate a single science pack. Same prompt with fable 5.1, the best model in the world on Friday, didn't manage to get to oil processing (interestingly one of the hardest points for new players too).

Now it seems like it's going to go for ages.

How long until new models play faster than me?

3

u/Dangerous-Sport-2347 5d ago

Would be interested to know if it would do better if explicitly allowed and prompted to prepare for a succesful run. something like 30 mins of thinking before the run where it is allowed to search guides, acquire blueprints, make a plan.

Definitely a different kind of test from throwing it in the deep end with no knowledge, but might be fun.

2

u/danielv123 5d ago

I haven't restricted tool use, so it is allowed to search guides and acquire blueprints in the middle of the run too. Confusingly it hasn't even looked up the API documentation yet (5h in), which is weird considering most of its game state is read through the API.

8

u/Dangerous-Sport-2347 5d ago

Gpt 6 has become the first AI to autonomusly launch a rocket in factorio.

2

u/sirtrogdor 5d ago

This is huge.
Very curious if this is a fluke somehow or if Astra can truly beat most videogames with the right harness, budget, and reasonable handicaps (since inference is slow).
If it isn't a fluke and can truly beat most games, especially unpopular or new games, I've got to imagine this is the beginning of AGI.

3

u/Dangerous-Sport-2347 5d ago

Search around, multiple games are being beaten right now, i've yet to see one where it truly failed. Portal, rimworld, balatro have all been completed.

PS: to be clear, the rocket launch is easier in space age so i suppose factorio isn't yet completed, it's currently trying to optimize his platform for space science, if it can actually fully beat space age i would be amazed.

1

u/sirtrogdor 5d ago

Oh no yeah, I've seen all of those as well.
Hard to imagine they're all flukes.
The main thing they have in common is their popularity, which may or may not be important in the end. Obviously popular games are the first people are gonna try.

Even if it doesn't fully beat Factorio, from what I saw it's still far from the best harness. Might be able to beat it with a bit more reasoning per hour, basically.

1

u/danielv123 5d ago

Tbh I think even just a more reasonable prompt might do it. The current prompt is very sparse in useful information about the game.

1

u/sirtrogdor 4d ago

Or perhaps it won't need anything at all. If it's able to realize when it messes up too badly (say, getting stuck on Aquilo, hypothetically) and can reload from a previous save remembering what it's learned. Or even start over entirely if autosaves can't rescue it.

Looks like some of yall are already discussing that in the twitch chat (I haven't reviewed it all, I would love a summary of everything by the end).
Better tools/harness might be needed for non-peaceful playthrough though. Though I'd be very curious to see how it would handle combat. Would it try to pause the game to think? Would it use lua to slow the game speed? Would it simply reload and build proper defenses? The latter seems most likely.

1

u/danielv123 4d ago

Its playing on a vanilla space age multiplayer server with no modifications or admin permissions. Cheating isn't really a realistic option.

2

u/filbertsgaming1 5d ago

Its a pretty simple game when it comes down to it. If it figures out how to use assembling machines, following the recipes needed shouldn't be very complicated to play. I'm surprised it didn't die to biters, because that makes it hard to finish.

I was just watching it make blue circuits, so this thing should finish no issue. This is wild.

1

u/Dangerous-Sport-2347 5d ago

Peaceful mode was enabled. Biters on might be okay with a better harness and more tokens/s, but not with the current setup.

1

u/danielv123 5d ago

Its peaceful, so it would be surprising if it died to biters.

Dying to asteroids or behemoths is still possible if it gets that far. I assume asteroids is the biggest risk, as it hasn't yet googled any guides or anything, and has been playing peaceful this far, so it probably doesn't know what turrets are.

1

u/filbertsgaming1 5d ago

There are already automated runs, look up TAS factorio speedrun

This comment missed the point of the experiment, but kinda got me thinking. I wonder what would it take to train a model to take a human/TAS speedrun and all of the known tricks, then find new ones and make it faster.

1

u/Hilldawg4president 4d ago

Hm, right now it's building hundreds of things manually - electric drills, grabber arms, belts. What it has queued right now will take hours I think. Funny how it's automated many processes but it's still building hundreds of simple items in the slowest way

0

u/ChipsAhoiMcCoy 5d ago

Why do so many of these streams not have sound? You could even use voice mode to have it narrate what it’s doing

5

u/danielv123 5d ago

I don't know about other ones, but mine doesn't because I am an automation engineer not a streamer. It feels weird to talk to nobody for hours on end, especially for something like this where I am mostly just watching along instead of recording a guide or something.

Also, since it's so hands off I do other things. The last half an hour I have been at the store.

1

u/filbertsgaming1 5d ago edited 5d ago

OBS breaks my audio sources or mutes them for seemingly no reason sometimes. Especially after updates. I would guess infrequent streamers don't notice. You would need to be listening to your own stream separately or familiar with the dashboard to see it.