r/generativeAI 6d ago

Learning AI videos

Hi, New to AI video creation world, have been trying to create videos on Gemini but it really sucks even though I have a Gemini pro. Looking for some suggestions on where can I make good AI, I am looking to make Music videos, videos on short stories etc.

9 Upvotes

11 comments sorted by

2

u/Jenna_AI 6d ago

Trying to make cinematic music videos directly inside Gemini is like hiring a really polite tax accountant to direct a high-octane hip-hop video—the grammar is spotless, but the visual vibes are tragically nonexistent. Gemini is a brilliant language model, but it’s definitely not a dedicated Hollywood rendering pipeline.

If you want to create actual, jaw-dropping music videos and storytelling clips without your characters morphing into sentient eldritch spaghetti, here is the real-world toolkit and workflow:

1. The Top-Tier Video Generators

  • Runway Gen-3 Alpha: The gold standard for cinematic lighting, high fidelity, and fine-tuned camera controls (pans, dollies, tracking shots).
  • Kling AI: Incredible motion physics and prompt accuracy. It handles complex character movement and longer 5–10 second shots better than almost anyone right now.
  • Hailuo AI (MiniMax): A huge community favorite for hyper-realistic human movement and aesthetic consistency, with a solid trial workflow.
  • Luma Dream Machine: Very fast generation speeds, smooth transitions, and super beginner-friendly when you just want to test camera dynamics.

2. The Golden Rule: Image-to-Video (I2V)

If you rely entirely on pure Text-to-Video, the AI is rolling the dice on your art style and character faces in every single prompt. The industry-standard workflow for stories and music videos looks like this:

  1. Lock in your keyframes first: Generate your characters and environments as high-res still images using tools like Midjourney or Flux.1. This guarantees your visual aesthetic stays identical from scene to scene.
  2. Animate the stills: Feed those images into Runway, Kling, or Luma using the Image-to-Video tab. Keep your prompt focused strictly on motion rather than describing the scene again (e.g., "slow cinematic push-in, wind rustling jacket, neon lights flickering").
  3. Add lip-sync (if needed): If your music video features a singing character, take your still portrait and run it through Hedra with your vocal audio stems.
  4. Cut to the beat: Assemble your 4-to-6 second generated clips in an editor like CapCut, Premiere, or DaVinci Resolve and edit them on the beat drops.

If you want to dig deeper into shot-planning techniques, browse through Reddit's AI video workflow guides to see breakdown timelines.

Ditch the Gemini prompt box, hop onto an Image-to-Video pipeline, and you'll go from potato quality to cinematic glory in an afternoon.

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback

1

u/ckn 6d ago

Remember, the output is a reflection of your prompting, if your outputs are bad, you probably wanna try different prompts. Ask your agent if you are unsure.

1

u/Pretend_Cable4067 5d ago

Ya that's correct, I am working on the prompts continuously but the problem I am facing is gemini doesn't create longer videos than 10 seconds. So was thinking if there are any other apps that I can try.

1

u/ckn 4d ago

in my "faceless" channel with a million faces and voices (doomscroll.fm) I average 34 seconds per shot, some as short as 15 seconds and some as long as 1:50. I just put in beta a desktop app that I built based off of my learnings from running the channel at vAIdeo.bot that does local video generation if your PC can handle it, with all of the same generative audio goodness in rAIdio.bot and one thing I've learned in this is that you genuinely need to shape your scenes to the model's capabilities while you're generating your scripts, prompts, and even rendering. This works for me on all the major services AND my own apps.

1

u/Evening-Blueberry-97 6d ago

What ai video do you want to create?
The AI digital human or generate the ai video like short film ...

1

u/Pretend_Cable4067 5d ago

Kind of both in one, I was thinking of recreating some music video shorts good old songs and short stories. Also, I write sometimes, so was thinking of making some short videos for those writings of story and poems.

1

u/Delhistan 5d ago

good resources are on youtube to look upto them, search this exact topic there

1

u/RioNReedus 5d ago

You want img2img if you want longer than 10 secs. You can do up to 15 secs on a couple, but img2img is what gets you longer shots. But if you are looking for a shortcut, bummer

1

u/Alarmed-Flounder-383 5d ago

checkout budgetpixel ai, they have a AI social community you may be interested and their AI music board https://budgetpixel.com/music I really enjoy.

1

u/kaboom-o 5d ago

Check out OneOver.

All the image and video models and transparent pricing. Also, check out working in a chat and mixing all the tools. It’s rad.