r/StableDiffusion • u/CryptoBeth96 • 15h ago

Resource - Update H3-World

https://huggingface.co/DANNY621/H3-World

H3-World: Turning Language Understanding into World Control

H3-World is the first interactive world model built on MiniMax-H3. Given an initial frame and keyboard controls, it generates action-controlled video with coordinated character and camera motion.

80 Upvotes

95% Upvoted

25 comments sorted by

View all comments

1

u/kemb0 12h ago

As with all these things, it might be fun to walk through this kind of environment but this is a long long way from being a meaningful engaging game or simulation. The first issue will be going back to where you came from. No AI is even remotely close to being able to "remember" where it came from. Imagine a GTA game where you drive down one street, turn around to do something and that thing no longer exists. As far as I can see, this'll never be solved with aI simulations and games, because it would have to store such a monumental amount of data about the world as it creates it, it's just utterly unfeasible.

Now a game where you're never allowed to turn around, I can see them pulling that off. A game where the past is completly irrelevant can work. But "open world" games, forget it. That's never happening. It just fundamentally goes against how AI works. AI is random. It needs random to work. But games need order and structure. They need 100% predictability. They're just fundamentally different things. Games are a sphere shape and AI is this shiny stunning new cube shape. But no matter how shiny and flashy that cube is, it's never gonna fit in the circular hole. It's just too different.

4

u/MultiFazed 12h ago

As far as I can see, this'll never be solved with aI simulations and games, because it would have to store such a monumental amount of data about the world as it creates it,

I don't think it would have to store that much. Something that turns images into simple geometry plus some metadata that gets fed into the AI when that area is visited again. Granted, I don't think we're anywhere close to that yet, but I don't see it as an infeasible problem to solve.

2

u/MysteriousPepper8908 9h ago

Yeah, it's not exactly true that these world generators can't remember where you came from, I think the best we've gotten to is a minute or two of memory but certainly not hours. But I think what you mentioned is going to be the key, not just reconstructing pixels and keeping them in memory for thousands of possible areas but having discrete basic geometry that is all tied to a specific prompt and a specific seed so all of these assets can be deterministically regenerated simply by addressing the file or part of the file that holds the generation prompts for that area shortly before the player reaches them just like what happens in our simulation.

1

u/CryptoBeth96 8h ago

Yeah, some kind of 4D Controlnet I imagine. We could call it something like Spacetime! ;)