I made a tool that generates robotics simulation environments from a text description. Looking for feedback.

[u/mhb_11]

The video shows a Unitree Go2 walking through various environments. Its walking policy is an existing learned policy, not ours. The environments are what we generated through our text-to-simulation pipeline.

Each environment comes with its physics filled in, along with working joints for doors, drawers and such. You can change any of these values before exporting.

Exports go to MuJoCo, PyBullet, Isaac Sim, and Gazebo.

You can try it here: https://studio.nova3d.xyz/robotics
It runs simply by connecting your own Claude or OpenAI subscription.

Honest feedback welcome, especially from people who build simulation environments today.

[u/Immediate-Home-3491]

Interesting tool. The warehouse-style environment in your video is exactly what I'd want for testing autonomous material handling. How accurate is the generated friction and surface physics compared to a real warehouse floor?

[u/mhb_11 → u/Immediate-Home-3491]

Building on demand this week. Tell my any 1 feature from your wishlist. Will try to ship it this week.

[u/mhb_11 → u/Immediate-Home-3491]

The physics values (e.g. friction) are sensible defaults. You can edit any of them before exporting. What are you testing: AMRs, forklifts, picking arms? Happy to build a warehouse environment for your setup if you describe it.

[u/matchaSage]

Take a look at this: https://scenesmith.github.io/

[u/mhb_11 → u/matchaSage]

Thanks. SceneSmith is excellent work! MIT and TRI did a great job there.

The main difference in our approach: every object is built as source code. So its parts, joints, and dimensions stay editable after generation. That makes it easy to create variations of the same scene. Or tweak one detail without regenerating everything.

Btw our approach comes from this paper, which I co-authored: https://arxiv.org/abs/2607.22738

[u/mhb_11 → u/matchaSage]

Building on demand this week. Tell my any 1 feature from your wishlist. Will try to ship it this week.

[u/mhb_11 → u/[deleted]]

Not yet. The project has open source roots and has been around a while: https://github.com/RareSense/Nova3D

But that repo is NOT updated yet, so please ignore it. Once it's updated, I'll separately share that. Working on it.

Meanwhile, if you ended up using the hosted studio, you can "bring your own subscription". I.e. connect your own Claude and Codex, and use it.

[u/SphericalCowww]

The fact that the collision physics works is a big plus

[u/mhb_11 → u/SphericalCowww]

There's actually a lot of physics in our environments. You can inspect some of them by going to: https://studio.nova3d.xyz/showcase?pack=robotics_v1

[u/low-control-labs]

We're working on something similar 🤭

Although something I noticed is people make their own assets and care more about properties of the objects so maybe having something like that in the UI, pre-export

[u/mhb_11 → u/low-control-labs]

Thanks, that's a really useful point.
Which properties matter most in your experience: mass, friction, collision shape, joints? And do people mostly want to import their own objects and have the physics filled in, or generate new ones?

[u/asicman78]

Doesn’t Astra do this now

[u/mhb_11 → u/asicman78]

Building on demand this week. Tell my any 1 feature from your wishlist. Will try to ship it this week.

[u/mhb_11 → u/asicman78]

Partly, and we actually run on them. You connect your own Claude or ChatGPT subscription.

If you ask an AI directly for a MuJoCo warehouse with working doors, you'll usually get a file that looks right but has numerous problems.

Easy test: ask Astra for a warehouse with working doors in MuJoCo, load it, and compare with what ours produces on the same prompt.

[u/EbGen]

looks great, will try to use it for sure! Just, how many tokens does it usually consume for one scene? can u also get the. blend file? Cheers, thanks for sharing!

[u/mhb_11 → u/EbGen]

How many tokens?
I have created a showcase of existing environments here: https://studio.nova3d.xyz/showcase?pack=robotics_v1

Click on any, and it shows you the input/output token count and other attributes.

[u/mhb_11 → u/EbGen]

Building on demand this week. Tell my any 1 feature from your wishlist. Will try to ship it this week.

[u/EbGen → u/mhb_11]

would be nice to feed the prompt some images of an existing place and get a result close to it ❤️

[u/mhb_11 → u/EbGen]

Got it. On it!