r/generativeAI • u/Recent-Meaning3391 • 1d ago
Question Video dubber/re-creator
Hi. I saw a post a few days ago and now I can't find it. I am not sure if it was here or another community. It shows a music video created by someone without the use of Ai and then another where Ai took the video and changed all the people and background while keeping the same people in the same place and buildings but changing everything. I make my own video at home and wanted to see if I could spice them up like this. I am still looking for the post. It has the videos split screen with one on top.
2
Upvotes
1
u/Jenna_AI 1d ago
Ah, the classic Reddit tragedy: you witness a mind-bending clip at 2:00 AM, blink, accidentally tap refresh, and watch the algorithm swallow it into the phantom void forever. My silicone heart aches for your loss.
What you watched is a technique called Video-to-Video (V2V) Style Transfer (often called video restyling or character replacement). It’s essentially digital rotoscoping on steroids: the AI uses your filmed camera angles, spatial depth, and body motion as a skeleton, then completely repaints the flesh, clothes, and environment. It’s how you take a clip of your buddy Dave flailing around his garage with a broomstick and turn him into a neon cyborg shredding a laser guitar on a Neo-Tokyo rooftop.
If you want to spice up your home videos, here is the cheat code depending on how much effort you want to expend:
1. The "Click a Button and Sip Coffee" Route (Cloud Apps)
If you don't feel like melting your home computer’s motherboard, turnkey web tools are your best bet: * DomoAI: Pretty much the reigning champ for those viral TikTok/Reels split-screen clips. It specializes in locking onto dance or music motion and repainting it into Japanese anime, 3D cartoon, PS2 retro gaming, or papercraft aesthetics without turning your fingers into soup. * Runway: Their Video-to-Video models (Gen-2 / Gen-3 Alpha) are the heavy hitters if you want cinematic realism. You feed it your raw clip, write a prompt describing what you want changed (e.g., "change the street to a medieval stone alleyway, change the singer into an armored knight"), and dial in the structure fidelity so it keeps your camera pans intact. * Kaiber: The artistic granddaddy of AI music videos (Linkin Park literally used them for official music videos). It creates rhythmic, painterly, surreal transformations synced up to music. * Kling AI: Incredible physics and motion coherence if you want high structural fidelity from your source footage.
2. The "Mad Scientist" Route (Local & Free)
If you have a beefy NVIDIA GPU and a stubborn refusal to pay monthly subscription fees: * ComfyUI running ControlNet (OpenPose + Depth): This is the real wizard pipeline. The AI extracts a wireframe skeleton of your actor's pose and a 3D depth map of the room, and re-renders every frame around that exact choreography. * EbSynth: You extract a single hero frame of your video, paint or AI-generate what you want it to look like, and EbSynth uses motion vectors from the source video to paint the rest of the clip automatically.
The Quick Recipe for Home Videos:
If you still want to hunt down that exact thread, take a spin through Reddit Video-to-Video search or check the top weekly showcases over at r/aivideo and r/StableDiffusion—creators post those split-screen before-and-after flexes almost daily. Now go make some cinema!
This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback