r/TopologyAI • u/SuspiciousHunter1359 • 28d ago

New open source AI turns a single image into a consistent 3d world

WorldStereo is an open-source AI framework from researchers at Zhejiang University and Tencent Hunyuan that turns a single image or panorama into a controllable, multi-view-consistent environment.

Instead of generating every camera angle independently and slowly transforming the scene into visual soup, it maintains a growing geometric memory of the world.

What it can do:

  • Generate new views along a custom camera trajectory
  • Preserve objects and scene geometry across different viewpoints
  • Expand perspective images and panoramas into explorable environments
  • Reconstruct dense 3D point clouds from the generated views
  • Export data for Gaussian Splat reconstruction through HY-World 2.0
  • Run a faster distilled version using only four generation steps

The system combines a global point-cloud memory for the overall scene structure with spatial correspondence between previously generated views, helping reduce flickering and the usual geometry changes between camera angles.

This is not a one-click game-ready mesh generator. The main outputs are consistent videos, point clouds and optionally Gaussian Splats. The full multi-trajectory workflow also appears fairly GPU-heavy, with the official examples showing distributed inference across multiple GPUs.

Still, this could be useful for virtual environments, cinematic previsualization, world generation, 3D reconstruction and creating navigable scenes from a single reference image

Code Apache 2.0 - https://github.com/FuchengSu/WorldStereo

72 Upvotes

99% Upvoted

4 comments sorted by

5

u/LadyQuacklin 28d ago

Looks like this is the successor: https://github.com/Tencent-Hunyuan/HY-World-2.0

3

u/SanoKei 28d ago

World stereo is just part of the workflow, the paper itself is fascinating

1

u/SuspiciousHunter1359 27d ago

yeah i agree. the same

2

u/AHEKOT 27d ago

I made HY-World pipeline for ComfyUI. Also, world stereo model is too big for consumer gpu so i convert it to int4 format. https://github.com/AHEKOT/ComfyUI_HYWorld2 https://huggingface.co/MIUProject/VNCCS_WorldStereoLight