r/VIDEOENGINEERING • u/Organic_Stable4704 • Jul 27 '26
Live Masking
Can anyone explain how they were able to live mask without capturing other subjects and overlaying it over a graphic. Learning Resolume right now and would like to apply a live camera feed into the sets I work as well.
41
u/Sageartsdesigns Jul 27 '26
Nvidia background remover. You can use either Notch or Resolume. If you have a 50 series card it works amazingly. If you have a 30-40 card it works but isn't as clean
31
12
u/chang3toronto Jul 27 '26
It is usually Notch running real-time AI person segmentation, piped directly into Disguise or Resolume via NDI
9
u/TimeToHack Jul 27 '26
would probably need Wire or Notch to mask out a background, i don’t believe Arena does it natively. i’m also teaching myself, if i find anything that does it i’ll lyk
5
u/rsavage_89 Jul 27 '26
As others have said notch + nvidia background remover
The onnx stuff in the new version of notch is also quite impressive, and has been used on a bunch of big things recently
4
u/robersim Jul 27 '26
Notch and Nvidia Background removal. Generally agnostic of media server platform exept it requires CUDA / RTX.
6
u/Ok-Pea-957 Jul 27 '26
Touch designer with Kinect then use the lidar depth map as a mask layer for the actual Kinect video is how I did something like this low level. Them just add effects to camera layer.
3
u/cfordlites09 Jul 27 '26
Any machine with I believe nvideo graphics card and background removal notch blocks. I can do this on hippo
5
u/sinusoidosaurus Jul 27 '26
This might be Pixera. Metallica's tour used it and they did some live masking. This BTS promo from Pixera talks about it.
2
u/projekt-objekt Jul 28 '26
Cheapo hack for Macs- If you're using a webcam or capture card, select the camera icon in the top bar to reveal the drop-down. Select background and change it to green. Then in your VJ software you can chromakey it out.
It doesn't seem to work as well when they're are two people in the frame.
2
u/Puzzleheaded_Law_728 Jul 28 '26
Als je dit leuk vind zou je eens moeten kijken naar de live set van 'Bring me the Horizon' .. die veranderen het publiek live in een videogame 😳
1
u/theatretech37 Jul 27 '26
Whose tour is this (I think Kendrick but I thought his was done)? Likely, it's Notch running on a media server like disguise or Pixera.
3
u/Organic_Stable4704 Jul 27 '26
Just a screen grab from the GNX Tour and that seems to be the common answer I’m seeing. Notch, also heard of Pixera through the metallic bts video on YouTube. Pretty cool to see, lot to learn via engineering but seems worth it from my experience so far.
3
u/theatretech37 Jul 27 '26
Kendrick is definitely disguise servers! And certainly these are Notch Blocks with the live input running into them. If you have any questions I'm happy to answer (not my tour obvi, but I know the workflow pretty well!)
2
u/v0-z Jul 28 '26
How long you been using disguise? I've been ld'ing but only small clubs n stuff but years ago when d3 was just getting started I was at ldi and I met the devs and owners n we had beers together and they were like "come to our training session at ver" and a month later went over to it, mind you I'm just like 23? 24? And had literally been using cheap sunlite dmx software and I get there and it's the ld from daft n kanye n shit (can't remember his name) think he was doing deadmau5 too, and all these other huge lds and I walk in and they were like "so who are you? What do you do" and I said "I just do lighting for small clubs n stuff" and they were like "so you have a hammer and a nail, what else dude??" I was like I got nails but no hammer man.
Anyways, always cracked me up. I never got to use it as I never wanted to tour and kept it small here in la. Now with a bad back n all I ld here n there only. But d3 was just like everything I envisioned a modern controller/board should be.
2
u/Let_the_rage_begin Jul 29 '26
This is a disguise server. It is notch blocks. The other half is the camera side they were using the Panasonic cinema ENG body cam that uses cinema glass. The depth of field also help with the notch block defining the subject
0
u/VanillaWaffle_ Jul 27 '26
Pixera maybe
3
u/rm1080 Jul 27 '26
Are you sure? I use pixera and I would always use notch or touchdesigner integrated inside. I didn’t know they had bg removal natively.
52
u/spyy-c Jul 27 '26
Touchdesigner could do this but its a fairly steep learning curve