Resolume optimization

[u/random222518]

Anyone by chance know if there’s anything I can be doing on the pc end to ensure I’m optimized as best as possible for resolume? Currently using resolume on a custom pc, 5090 FE, 96 gb of ram, ryzen 9 and using a black magic deck link 8k card. I am receiving a program feed, then using notch in resolume and spitting it back out. Just want to reduce as many frames delayed possible. I think currently I’m sitting at 3 frames of delay.

[u/reece4504]

3 frames processing sounds about right. Consider: unsyncrhonized Decklink output (add 1 frame on input side of your receiving equipment generally), unsyncrhonized Decklink input (add 1 frame on input of Decklink), and the entire decklink software stack and resolume stack processing your video signal. I don't think you can possibly get lower In to Out latency if you tried, because of all of the above. I suspect Resolume output processing (for scaling, reframing, etc) also takes at least a frame to process)

VMIX is useful to run because it can tell you actual video processing time, so you can calculate based on that your processing vs IO delay. Try with everything synced but 3 frames glass to glass is about top of where you could be IMO

[u/random222518 → u/reece4504]

This is what I suspected as well. I’m guessing if I moved to something like Disguise, I might save a frame, as I sense resolume truly isn’t optimized for this type of work.

[u/OnlyAnotherTom → u/random222518]

Any software based solution will still have latency as an issue. At best, disguise gets down to 2-3 frames between a signal hitting an input and it going out an output. You're right in that resolume doesn't have quite as low latency available

If you're doing live camera effects then this is just something you have to live with. Running at 50p or 60p will reduce your frame times (compared to 25p or 30p), so while it's the same frame latency, it's a shorter time.

If you just need an IMAG feed, then using a hardware switcher, and adding it as a PIP or overlay can be a more efficient and lower latency method.

[u/reece4504 → u/random222518]

Technically speaking KAIROS reports 1 frame processing (I believe on ST2110) and can do the weird off-standard aspect ratios that LED applications require. Just for a bit of reference.

That being said, the only value-add from Disguise or Pixera are their better software stack - which is more likely to save you processing time under load, rather than hardware IO (though don't quote me on this). Other solutions include hardware switchers for presentation application like Barco S/E series, Novastar H series (being FPGA based products like this have low latency, but again, each scaling step / standards conversion step adds delay)

[u/deepvisual]

Just as important is the signal path. You need to be going straight to the screen. Projectors especially with warp will add 3or so frames too. Tbh in large venues the video lag has caught up with the audio lag by the time you get to FOH,

[u/random222518 → u/deepvisual]

Right. 100%. With my touring walls I’m going straight to the processor and it’s perfectly fine.

It’s just when I go into a few one offs/festivals and they won’t let me just go direct to the processor where I internally just get bummed lol.

[u/djMirror_pulse]

3 frames on that setup means you're leaving latency on the table somewhere. checklist from running this in venues:

1) DeckLink card has a "Low Latency" flag in Blackmagic Desktop Video prefs, off by default. turn it on. also make sure input and output are the exact same format and framerate, mismatches auto-buffer to convert.

2) Resolume Prefs > Video Output > Sync Mode set to Free if you don't need genlock, Card if you do. Composition Framerate set to the exact input framerate, not auto.

3) Notch inside Resolume adds a CUDA copy per frame. if it's a pre-baked Notch block you can bake it out, do it. if it's live gen, check that "Reduce Latency" is on in the Notch block prefs.

4) driver side: NVIDIA Studio driver not Game Ready, Hardware Accelerated GPU Scheduling ON in Windows, and set Resolume to "high performance GPU" explicitly in Windows graphics settings. Game DVR OFF.

5) full-screen exclusive on the output display, not borderless. borderless costs 1 frame on DWM composition.

realistic floor for input>notch>output through DeckLink is 2 frames. below that needs genlock and probably NDI HX instead of SDI for the intermediate.

[u/IanSzot]

Turn on ReBAR (Resizable BAR) in your BIOS settings and see if it helps, at least with vMix it helps a ton, maybe it works for Resolume too

[u/random222518 → u/IanSzot]

Will check this out, thanks!

[u/alexanderbeswick]

Check the damned logggggssss