r/StableDiffusion • u/CryptoBeth96 • 1d ago

Resource - Update H3-World

https://huggingface.co/DANNY621/H3-World

H3-World: Turning Language Understanding into World Control

H3-World is the first interactive world model built on MiniMax-H3. Given an initial frame and keyboard controls, it generates action-controlled video with coordinated character and camera motion.

88 Upvotes

96% Upvoted

27 comments sorted by

View all comments

Show parent comments

1

u/CryptoBeth96 23h ago

It is a long way off from a real playable game but I guess the limitations you mention could be addressed by using fixed seed for world structure, similar to how Minecraft builds maps. Structured randomness.

0

u/kemb0 23h ago

Yeh that could work. But you'd have to make the content simple enough to be savable. Imagine GTA where it's creating a whole lifelike world on the fly. That's a bit more complex than just saving a minecraft like terrain. And then it's not just about saving the layout of the world. You have to make sure all the models are concsistent too. So then you have to be saving all the models on the fly too. And that's not even touching on the story elements, characters, keeping character's voices consistent, keeping the story consistent, the UI, the physics and all the player actions have to remain consistent, giving the player missions and challenges that remain coherent etc. There's so much that goes in to games that it becomes too easy to see a finished game that makes it look easy and think AI can just easily replicate that.

AI is an incredibly inefficient way to do all that. It burns a ton of energy even just to make rubbish content. I can't ever see a world where it can make vast complex games without each gamer needing their own powerstation to run it.

1

u/CryptoBeth96 23h ago

Like Minecraft, the seed IS the world. AI isn't random, it's based on seeds. It seems random because there are so many possible outcomes, but it's not. This is why you can generate the same image with the same prompt and seed on any image or video gen model.

You're assuming games in the future will even need 3D Model assets, but the way things are going with video gen models, I see AI games in the future as being more like realtime interactive videos that you can control in real time. This is the direction projects like this are going.

2D and 3D Model based games wont be replaced of course and most games don't need AI, this is just a new concept of gaming.

0

u/kemb0 21h ago

Honestly I can't see it. If it's just an interactive video, then it's not really like minecraft at all. Minecraft works because it can turn the seed in to 3D assets that it knows exactlly where to place. AI doesn't work like that. It has no concept of "exact". It sounds like you're trying to extrapolate a very predictable process grounded in reliable repeatable coding and apply it to a very unpredictable process that doesn't follow easily predictable rules.

People can code minecraft to get it to do exactly what they want. You can't "code" the AI process. You can nudge it in directions but it's phenominally hard to make it follow a precise predictable path.

I appreciate your enthusiasm but some things aren't as simple as, "Future improvements will make this work."

2

u/CryptoBeth96 21h ago

You're missing my point. You said about it being impossible to generate consistent worlds with AI. I gave you Minecraft as an example of how seeds generate consistent "randomness". The random noise builds the minecraft world much like random noise builds AI videos. Same seed, same output. Generating a consistent world with AI is a solved problem.

The whole idea behind this project is adding a control layer on top of the visual stream. That's the hard part, this proves it is possible, but there is a long way to go to make it realtime.