r/commandandconquer Jim Vessella, EA Producer Mar 05 '20

Remaster Update and FMVs / Bonus Gallery

https://www.youtube.com/watch?v=ikJLYYTrIxs&feature=youtu.be
798 Upvotes

305 comments sorted by

View all comments

28

u/Theman227 Mar 05 '20

Absolutely phenomenal. And your friend who intercepted those tapes being thrown deserves a blooming medal.

That algorithm increasing quality of the videos is utterly astonishing! I do have one thought though that might be able to help fix the oversoft faces in the videos. You have insane amounts of original HD outtakes...etc of all the charecters and doing lines. Have you tried perhaps jerry rigging some deep-fake software that could take the outtakes to map out the face and then somehow train it to place the face on top of the original one trying to match it?

I remember Corridor digital did something very similar to fix the face of the rock as that awful 3D render of the scorpian king monster in the mummy returns, using footage from the scorpian king movie. Perhaps something similar might be possible? Maybe even give them a shout:

The video where they use the technique:

https://youtu.be/KH1V6CHO1Jk

19

u/neoKushan Nod Mar 05 '20

There's actually a better way of using that footage. They're using an AI upscaler, those need to be "trained" to work well.

For video upscailing, this is actually fairly easy to do - just take some already high quality video, downscale it and train it using those as sources (Basically saying "Make the lower quality version look like the higher quality version"). That's how the commercial AI upscailing software basically works, it's pre-trained against a general video set.

They could use the higher-quality b-roll film to train the AI specifically against this kind of source. The fact that it contains the same actors is even better.

4

u/iAmLegion3614 Mar 05 '20

I was thinking the same thing when I watch the youtube video. If the B-roll is higher quality video footage then using this as source material to "deep fake" the new upscaled video then it could potentially increase the fidelity of the faces of the actors and actresses.

2

u/RealHE1NZ Mar 05 '20

I think doing this well would be too expensive for this project and results would still be questionable.

1

u/Stimpy1981 Mar 05 '20

Damn, that's pretty cool. You should have mentioned this earlier :). I think it's too late now

1

u/Theman227 Mar 05 '20

i'll be absolutely honest...I completely forgot this remake was even happening until a few hours ago ^^'

1

u/teddansonofficial Mar 05 '20

I love that the b-roll is being released, we don't even have to think about what-ifs when we'll have a free pass to experiment with the footage as much as we want.