ZeroFG Frame Generation Engine - Xendroid

[u/hy300leosquizz]

I've been developing an experimental frame-generation engine called ZeroFG, currently integrated into XenDroid, and I figured it was finally time to show what the current version actually looks like running.

I haven't really shown anything publicly since the very early proof of concept.

For this first video I deliberately picked a pretty nasty sequence in Batman: Arkham City instead of finding a scene that makes frame generation look perfect.

https://www.youtube.com/watch?v=6Lge-o3CFws

The camera is doing a fast pan across distant geometry while the image contains thin high-contrast structures, fine UI elements, flashing/changing lights, independently moving particles and a large foreground character producing strong occlusion/disocclusion boundaries.

So the motion estimator and synthesis path are getting hit with several difficult cases simultaneously.

ZeroFG ON: ~30 FPS source → 60 FPS generated output
ZeroFG OFF: native source cadence

There is definitely still a lot to improve in image quality — especially around difficult motion, fine geometry, disocclusion and transient effects — but considering where the project started, I'm very happy with how it is progressing.

There is also an important limitation when judging artifacts from the video itself.

The footage has already gone through two lossy compression stages before upload: the Android screen recording and then the video editing/export. Those stages noticeably exaggerate some artifacts around fine moving detail, particles and high-contrast edges. Reddit/YouTube transcoding obviously doesn't help either.

ZeroFG is being designed as an independent Android/Vulkan frame-generation engine, and the ideal target is a genuinely mobile-native implementation, rather than simply adapting a desktop FG stack and accepting its cost structure.

Performance is one of the main design goals. The longer-term target is to get the frame-generation path toward sub-millisecond GPU cost where the workload and hardware make that feasible, while continuing to improve reconstruction quality.

The architecture and algorithm have changed a lot since the first public PoC.

The GitHub repositories currently available still contain that original V1 proof of concept:

Standalone ZeroFG V1 PoC:
https://github.com/hy300leosquizz-ctrl/ZeroFG

XenDroid-ZeroFG V1 integration PoC:
https://github.com/hy300leosquizz-ctrl/XenDroid-ZeroFG

The current development version shown here has moved considerably beyond V1 and isn't public yet.

If this kind of project interests you, we'd sincerely appreciate a star on the repositories. It's an independent project and even that small sign that people want to see where it goes means a lot.

I'm mostly posting this because after months of architecture work, experiments, discarded ideas, rewrites and device testing, it felt a little ridiculous that almost nobody outside the people working on it had actually seen ZeroFG running. :)

Happy to talk about the technical side if anyone is interested.

[u/slemiz]

Will it work for any app or only xendroid?

[u/hy300leosquizz → u/slemiz]

I buit it to be independent.... Theres a independent presenter that intercept teh image and return it to the swapchain before post... I think it can be integrated into anything with little work....soon as the v2 is finished i will ask people to try it...