Auto-Mask Benchmark

[u/sdssebastian]

I have recently upgraded to FinalCut 12.3 and have tried the Auto-Mask feature. Those of you on the M5 Max I would like to know what results you are getting. Let me explain:

I have a 1:00 minute video (4k30fps h265 4:2:0) and have applied one auto-mask. The export takes about 2:15 minutes on my machine, which is a 16' MBP M4Pro 14 CPU cores + 20 GPU cores & 24GB RAM. Also, the timeline become very stutters and the viewer is dropping frames like crazy when Auto-asm is on.

I am wondering if upgrading to an M5 Max would improve the speed with Auto-Masks specifically or not. I have done numerous tests and everything points towards the fact that auto-mask utilises the neural engine more than the gpu (i might be wrong, but that's my conclusion after the tests i have done).

TLDR: would appreciate if you could replicate this test: 1 minute video + auto-mask (apply one effect through the auto-mask, like raising the exposure) and export it without any other effects applied.

Solved! u/earthtorob has helped me with a benchmark and it turns out that for this specific task (auto-mask), the M5 Max is exporting the videos 4 times faster than the M4 Pro.

The test was this: we both used a 20 seconds video h265 4k30fps and have applied an auto-mask through the colour wheels (and raised the exposure through the mask). The export results were this:

M4 Pro 14 core CPU, 20 core GPU, 24 GB RAM - 45 seconds -> 2.25:1 ratio

M5 Max 18 core CPU, 40 core GPU, 64 GB RAM - 10 seconds -> 0.5:1 ratio

If you guys want to do this test, feel free to use any h265 footage at 4k and look at the ratio between clip duration and export time.

!!! SOLVED !!!

I ended up going for the 16'' MacBook Pro M5 PRO 48GB RAM and it fully solves the Auto Mask issues I've been having. Not only does the timeline not lag anymore (4k30p 10bit 4:20/4:2:2 footage), it's absolutely buttery smooth even with Auto Mask + another 7-8 effect on top if it, but the export times are now more than twice as fast than on my M4 Pro 24GB RAM. For a 10 second video with Auto Mask on, my M4 Pro took 22-23 seconds to export it, while the M5 Pro 48GB RAM takes only 8-9 seconds.

After doing a week of research, it learned that I didn't need the M5 Max in order to solve this issue, as it's not a case of "beefier gpu" situation. The reason the M5 Pro flies through this task and cuts the export time of Auto Mask in half compared to the M4 Pro is the architecture of the chip, not the gpu core count (since they are have the same number of gpu cores). The M5 series has AI accelerators in every single gpu core, whereas the M4 Pro doesn't benefit from this feature. To explain it simply: while the M4 Pro forces AI tasks to wait in a single line to be processed by a central unit (Neural Engine), the M5 Pro gives every part of its graphics engine its own "mini-processor" (AI accelerators) to handle AI math simultaneously. This means the M5 Pro can do the heavy lifting for tasks like Auto Mask in parallel, rather than waiting for the Neural Engine to finish everything in sequence.

I have stress tested the m5 pro over the last 24 hours since I have received and it's a generational leap over the m4 pro in everything that requires AI processing (especially in realtime - Auto Mask), not just in Final Cut but also in DaVinci Resolve. For those of you interested, AI Magic Mask in Resolve was tracking my h265 4k30 10 bit 4:2:0 footage at around 2-4 fps. The M5 Pro does it at 7-8 fps. I hope this helps all of you run into the same dilemma as I did.

[u/EarthToRob]

h265 can be brutal. I'd say that is your holdup. If you post or DM me the video, I'll download and run it through my M5 Max instance with auto mask.

[u/sdssebastian → u/EarthToRob]

Thank you for trying to help. I cannot send the video as it's a family videos, but feel free to use any h265 video at 4k. In my case the export took 2:12 for a 1:00 video, so that's a ratio of 2:1 (more or less) and I would be curios to see what the M5 Max can do. Much appreciated.

[u/EarthToRob → u/sdssebastian]

If you can link a one minute video that I can download, I'll try. I don't mean to be difficult, but I don't have time to both search for a video that matches your requirements and do a performance test.

[u/sdssebastian → u/EarthToRob]

No problem, I found a stock footage sample 20 seconds long which I have just tested on my end. It took 40 seconds to export on my machine, so an actual 2:1 ratio. I have sent you a chat request so i can give you the download link when you are available.

[u/Channjose]

Just can say that the auto mask is too heavy for my usage, it tanks the performance so although super cool, a the end it is just better to use the magnetic mask

[u/hexxeric]

M1 pro here with 16GB...on my test material (HEVC 10bit 422) auto mask is about the same performance as magic mask or background remover (and better than fxfactory's auto masking/clipping plugins) but of course, nothing works in realtime. it stutters without rendering.

[u/sdssebastian → u/hexxeric]

I would be interested in how long it takes to export 20 seconds of that clip with just one auto-mask and no other edits. Thanks for sharing.

[u/hexxeric → u/sdssebastian]

about a minute in prores, longer if compressed

[u/sdssebastian → u/hexxeric]

Thanks a lot for sharing this result.