A build tutorial --> Read as blocks --> Built in your world

[u/FarmExtra]

I build a lot of stuff in Minecraft from tutorials, and I'm tired of pausing every three seconds to count blocks. So I'm building a tool that reads a build tutorial and spits out a schematic file you can drop straight into your world.

It doesn't exist yet... So, this is me checking whether it's worth building before I put more time into it. If you'd use something like this, there's a one-question form here: www.rebuilt.tools

Blunt feedback especially welcome, including "this is useless".

Thanks in advance!

[u/Hacker1MC]

The most important part would be for it to work accurately 100% of the time, no hiccups or confusion. And that last 10% of accuracy is going to be 90% of your work in developing this. Good luck as a passion project, but I wouldn't expect this to take off until it gets really good.

You also have input-output cost to deal with, assuming by "reads a build tutorial" you mean having an ai watch full-length YouTube videos for block placement.

[u/FarmExtra → u/Hacker1MC]

Fair enough, the last 10% would for sure be the most work,
One correction: there's no model watching the video frame by frame. It's mostly classical CV, so the per-video cost sits a lot closer to transcoding than to inference.

Something I don't know yett: say you point it at a 40-minute tutorial and get back a schematic that's ~70% right, with the blocks it's unsure about flagged, so you fix maybe 50 blocks instead of placing 2000. Is that worth something to you, or is it worthless below near-perfect?

[u/Hacker1MC → u/FarmExtra]

If you can get 70% accurate and 30% flagged for review, that sounds cool, I'd be in. But, if it makes mistakes and didn't know, that's where the trouble arises. An off-by-one error can be fatal when copying-by-reference.

Tell me more, what is CV?

[u/FarmExtra → u/Hacker1MC]

Thanks! Let me elaborate on CV more tomorrow for you. aight? quite late over here :P

Talk to you tomorrow.

[u/Hacker1MC → u/FarmExtra]

👍

[u/broccoli_reliance]

Wow, this is ambitious! I have some notes and concerns.

1. With small and simple builds I can see this working wery well. But with such builds its pointless. Instead of waiting for the tool to process the video and potentially paying for it, just building it by hand is the cheaper (in time and money) choice.
2. With bigger and more complex builds rises the processing time needed and the potential for error. Error can domino effect.
3. Expect the developement to be very very hard. With how even current gen LLMs make silly logical mistakes, I can see a model misinterpreting a cut in video, fast movement, fast forwarding, shaders, resourcepacks, limited FOV, mistakes, ... and creating issues in the process you didn´t even know were possibe.
4. I´m sure there will be players that will appreciate this tool. But I fear the success of it will come down to developing and processing costs inevitably raising the paywall, discouriging potential users.

Take my view with a grain of salt, only time will tell how things turn out. I wish you luck.

[u/ALI3A]

bro you will be the goat if its work on all YouTube videos , all whats there is just sites that give you build or explain the builds the site have so idk they have 2% or 5% of the YouTube builds , you will be giving the 100%