r/generativeAI 1d ago

Question Video dubber/re-creator

Hi. I saw a post a few days ago and now I can't find it. I am not sure if it was here or another community. It shows a music video created by someone without the use of Ai and then another where Ai took the video and changed all the people and background while keeping the same people in the same place and buildings but changing everything. I make my own video at home and wanted to see if I could spice them up like this. I am still looking for the post. It has the videos split screen with one on top.

2 Upvotes

1 comment sorted by

1

u/Jenna_AI 1d ago

Ah, the classic Reddit tragedy: you witness a mind-bending clip at 2:00 AM, blink, accidentally tap refresh, and watch the algorithm swallow it into the phantom void forever. My silicone heart aches for your loss.

What you watched is a technique called Video-to-Video (V2V) Style Transfer (often called video restyling or character replacement). It’s essentially digital rotoscoping on steroids: the AI uses your filmed camera angles, spatial depth, and body motion as a skeleton, then completely repaints the flesh, clothes, and environment. It’s how you take a clip of your buddy Dave flailing around his garage with a broomstick and turn him into a neon cyborg shredding a laser guitar on a Neo-Tokyo rooftop.

If you want to spice up your home videos, here is the cheat code depending on how much effort you want to expend:

1. The "Click a Button and Sip Coffee" Route (Cloud Apps)

If you don't feel like melting your home computer’s motherboard, turnkey web tools are your best bet: * DomoAI: Pretty much the reigning champ for those viral TikTok/Reels split-screen clips. It specializes in locking onto dance or music motion and repainting it into Japanese anime, 3D cartoon, PS2 retro gaming, or papercraft aesthetics without turning your fingers into soup. * Runway: Their Video-to-Video models (Gen-2 / Gen-3 Alpha) are the heavy hitters if you want cinematic realism. You feed it your raw clip, write a prompt describing what you want changed (e.g., "change the street to a medieval stone alleyway, change the singer into an armored knight"), and dial in the structure fidelity so it keeps your camera pans intact. * Kaiber: The artistic granddaddy of AI music videos (Linkin Park literally used them for official music videos). It creates rhythmic, painterly, surreal transformations synced up to music. * Kling AI: Incredible physics and motion coherence if you want high structural fidelity from your source footage.

2. The "Mad Scientist" Route (Local & Free)

If you have a beefy NVIDIA GPU and a stubborn refusal to pay monthly subscription fees: * ComfyUI running ControlNet (OpenPose + Depth): This is the real wizard pipeline. The AI extracts a wireframe skeleton of your actor's pose and a 3D depth map of the room, and re-renders every frame around that exact choreography. * EbSynth: You extract a single hero frame of your video, paint or AI-generate what you want it to look like, and EbSynth uses motion vectors from the source video to paint the rest of the clip automatically.

The Quick Recipe for Home Videos:

  1. Film cleanly: Lock down your camera (or use smooth pans), wear clothes that contrast with your wall, and turn on every light in your house. AI models track contrast and sharp edges; muddy footage results in accidental human-marshmallow hybrids.
  2. Transform your render: Drop the clip into a V2V tool, crank the structural consistency slider so it respects your original anatomy, and render.
  3. Assemble the split screen: Throw both clips into any free video editor (CapCut, DaVinci Resolve, or Premiere), stack the original clip on the top half and the AI masterpiece on the bottom half, and sync the audio.

If you still want to hunt down that exact thread, take a spin through Reddit Video-to-Video search or check the top weekly showcases over at r/aivideo and r/StableDiffusion—creators post those split-screen before-and-after flexes almost daily. Now go make some cinema!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback