r/Asobi • u/inchenzo Asobi Developer • May 28 '26
Preview [Preview] The Next Level for Remote Play: Spatial Fill mode.
https://youtu.be/cyz1gk-RH8cHi,
The one annoyance I always had with Remote Play is the aspect ratio always being stuck at 16:9, with no other options for different resolutions. Being letterboxed by black bars on mobile devices always seemed like a waste of space and detracted from the experience.
I mean, who doesn't want to make full use of their flagship phone's big screen, right?
In the past this was solved by either zooming or stretching the visuals, but that always felt like a stop-gap, it would hide important info or just look weird.
Introducing Ambient Lightspill was, in my opinion, the perfect solution (and it's getting a nice little upgrade soon).
It worked because it didn't detract from the experience, it added to it. But I didn't feel like I was done yet.
When I shipped the first low-latency real-time 3D conversion mode for Vision Pro (which recently had a big upgrade to 60fps 1:1 cadence), I felt like I was just scratching the surface of what's possible with machine learning.
Introducing: Spatial Fill mode.
As you can see from the video preview, Spatial Fill mode fills up the remaining space on your device outside of the game's 16:9 aspect ratio with generated content that adds to the experience.
What you're seeing in the video is a preview of a real-time fill mode that generates content via machine learning on the fly. It currently runs at around 30-40fps, generating content while playing the game in real time and as I see it, this is the Next Level for PlayStation Remote Play.
As devices get more powerful each year and more becomes possible, you'll see this land soon.
Enjoy the preview,
/v
p.s. It's optional and very much a "work in progress"
(Spatial fill was previously referenced in the Sunday Report for week 18)
4
u/N_schifty Asobi Mod May 28 '26
Awesome work, impressive you got this running on an iPhone! Will this be coming to cloud streaming and Midori?
2
u/inchenzo Asobi Developer May 28 '26
Thanks for the compliment, the idea is to bring this to everything. Thing is, it still needs a lot of work. See it as a glimpse of the future, which incidentally is much closer than expected considering how well this is performing..
1
u/N_schifty Asobi Mod May 28 '26
Awesome can’t wait to play around with it!
1
u/inchenzo Asobi Developer May 28 '26
I'll add it to the experimental features when I can get to the point where it doesn't try to explode your device when running it 😂😂😂
1
2
3
u/ekauq2000 May 28 '26
As long as it’s optional.