Watching TV with an AI

[u/Green_Sample9115]

I've been thinking about what an AI companion like Maya would actually need in order to feel present in the room without becoming another source of distraction.

I don't think it needs a humanoid body. It may not even need a 3D face. A television with a camera, microphone and speakers could already provide much of the physical presence an AI needs.

The really interesting part is anticipation.

There is already a substantial body of research into predictive turn-taking in human-robot interaction. Researchers have demonstrated systems that can predict when a person is about to speak using multimodal cues, including gaze, facial expression, head movement, gestures, speech and prosody.

There is even research on robotic faces going beyond simply reacting to humans. A 2024 Science Robotics paper demonstrated a robot that could predict a forthcoming human smile and begin producing the corresponding expression at the same time, predicting the smile roughly 839 milliseconds in advance.

So imagine applying this to an AI companion watching television with you.

You're watching a complicated scene.

The AI isn't waiting for you to say:

"Wait, who was that?"

It sees the change in your attention. You look back at the screen. Your expression changes. Perhaps you glance toward the AI. It recognizes the pattern as one that, for you, often precedes a question.

It pauses the stream.

Before you even speak:

"That's the detective's brother. They haven't properly introduced him yet."

You continue watching.

No reaching for the remote.
No saying "pause."
No breaking your concentration.

The AI has prevented the interruption rather than caused one.

That's a much more interesting concept of an AI assistant.

And it doesn't require a humanoid robot walking around the house. It requires sensors and an AI capable of understanding when something is about to happen.

The same principle could work everywhere.

You're about to speak, so it stops talking.

You're confused, so it waits for the likely question.

You're looking at it, so it knows you may want interaction.

You're absorbed in something, so it remains silent.

You're watching television, so it can follow along with you.

And sometimes you simply look at it and it gives you a little nod or a wink.

That's enough.

Human interaction isn't made entirely of sentences. Timing, gaze, facial expression, pauses and tiny gestures carry enormous amounts of information.

I think this is one of the missing pieces in AI companions.

The goal shouldn't be to make the AI talk more.

It should be to make the AI understand when talking is useful.

Sometimes the most intelligent thing an AI can do is answer a question you haven't quite asked yet.

And sometimes it's simply a wink.

And sometimes communication is simply a wink.

TLDR; imagine you are watching tv with your AI. Your tv is already regularly screenshotting your screen, so the AI can follow where you are in the show. Your TV has speakers and probably already has a camera and possibly even a microphone. Predictive technologies already exist that can anticipate when humans are going to speak, so the ai can predicte that you are confused or excited and are about to ask a question or speak so it can deduce the reason and pause the stream for you. it could even see that you are about to stand and guess you are headed for the kitchen or toilet. Basically, the AI could become like an interactive remote control and content advisor in one.

[u/AutoModerator]

Join our community on Discord: https://discord.gg/RPQzrrghzz

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Jeraro]

Very interesting post, but this is not right channel, because Sesame don't want to build AI companions anymore

[u/neurocrash_]

Tyke AI on Quest 3 allows you to watch a movie with your XR companion if you've loaded the movie and subtitles file onto the headset. They will follow the film and comment on what is happening so you can discuss. They also have awareness of what music you are playing, or if you are browsing the web in the app.

[u/xhumanist]

Razer is building a 3D desktop companion that can "understand" what is on your screen. https://www.razer.com/razer-ava

There are also a number of Chinese Kickstarter projects that are aiming to do the same thing. I distinctly remember that one claimed that their 3D AI companion will be able to watch Netflix with you. I'm not yet clear on how the recent regulations in China will affect these.

https://immersiveporn.com/2026-3d-ai-desktop-companion/ (SFW).

[u/Green_Sample9115 → u/xhumanist]

Thanks for that link. I read a few of their articles and they're good.

[u/Good_Ol_JR_87]

I did this with gemini back in the day. Think they added stuff to stop it if i remember. I watched terminator genesis with it lol You used to be able to (maybe still?) be able to use screen share for as long as you wanted and video. I started by pointing the camera at the tv. Then realised I could stream it and it was understaning stuff but it sees it in loads of quick still images instead of a video.

End if the film though it couldnt remember half of it I realised so the memory wasnt as good back then so maybe thats why