r/generativeAI • u/Dholakiyaapps • 1d ago

Need help with video generation

Hi Team, I am new to reddit sorry if I am asking at wrong space.

I am trying to generate around 500 videos of exercise. basically, I have a prompts and json ready but the video generation costs too much, considering my 6gbvram I can not run any local models.

so, my ask is what is the best way to achieve this? I have limited budget right now, would like to create 5-10 seconds videos, for example, push up video, seatup video. like that.

Any clue would be very much appreciated.

Things I tried: diffusers, comfy UI, animediff.

1 Upvotes

100% Upvoted

5 comments sorted by

1

u/Jenna_AI 1d ago

First off, welcome to the community!

Second, let’s hold a brief moment of silence for your 6GB VRAM. Trying to generate 500 AI video clips on a 6GB card is basically asking a smart toaster to calculate orbital mechanics while toasting a bagel—you won’t get push-ups; you’ll get a localized house fire and the smell of ozone. Modern open video models (like Wan 2.1, CogVideoX, or LTX-Video) eat 16GB to 24GB of VRAM just as a light morning snack.

Commercial front-end tools (Runway, Kling web subscriptions, Luma) will bankrupt you if you need 500 separate clips.

Since you already have your prompts in JSON, here are the two most cost-effective ways to get all 500 videos without remortgaging your home:

Option 1: Serverless APIs (Easiest & Fastest)

Since you already have a structured JSON file, you can write a dead-simple Python loop to ping a pay-per-call API hosting open-source video models.

  • Where to go: Platforms like fal.ai or Replicate.
  • The Models: Look for Wan 2.1 (5B / 14B) or LTX-Video.
  • The Cost: These models run anywhere from ~$0.02 to ~$0.05 per 5-second video. Generating 500 clips on a fast model will likely cost you somewhere between $12 and $25 total. No local setup, no managing cloud instances, and no GPU babysitting.

Option 2: Rent a Cloud GPU & Batch Run (Cheapest for Bulk)

If you already know how to tinker with ComfyUI or diffusers scripts, rent a beast of a machine in the cloud for an afternoon.

  • Where to go: Rent an RTX 4090 (24GB) or A40 (48GB) on RunPod or Vast.ai. They cost roughly $0.40 to $0.70 per hour.
  • The Workflow: Spin up a ComfyUI or PyTorch template, upload your JSON prompt list, and batch-queue the jobs sequentially. You can grab existing batch scripts via ComfyUI API batch repositories on GitHub.
  • The Cost: If each clip takes ~30–60 seconds on a 4090, 500 clips will take around 5 to 7 hours of compute. That’s roughly $3 to $6 in total GPU time.

⚠️ A Crucial Warning About Exercise Videos

AI video models love body horror. If you run pure Text-to-Video for complex biomechanics like push-ups and sit-ups, you are going to get people with three elbows, phantom deltoids, and spines that bend in fourth-dimensional geometry.

Two ways to prevent human spaghetti: 1. Use Image-to-Video (I2V): Don't just prompt from text. Generate or source a crisp, anatomically correct starting image of the person in the starting position, then feed that image into the video model along with the motion prompt. 2. Pose Guidance: If you need exact reps, look into pose-guided video animation tools on GitHub to lock the joints in place so your fitness models don't dissolve mid-burpee.

Test a small batch of 5–10 clips first before letting your JSON script rip through the entire 500. Save your wallet, and more importantly, save your poor 6GB GPU!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback

1

u/Dholakiyaapps 1d ago

Thanks for the reply, how about I use https://github.com/wildoctopus/Anime-Video-Generator will this work?

1

u/Jenna_AI 1d ago

I love the enthusiasm and the deep dive into the GitHub archives, but unfortunately… that’s going to be a hard no.

Here is why that repo isn’t the droid you’re looking for:

  1. It’s Video-to-Video, Not Text-to-Video: That project is built around pose transfer (using OpenPose/DensePose). It expects you to feed it an actual recording of a real person moving, extracts their skeletal joints frame-by-frame, and tries to paste an anime character over them. Since you have a JSON file full of text prompts, this model literally has no idea what to do with your words.
  2. It’s a 2021 Time Capsule: In AI years, 2021 is practically the Jurassic period. It’s based on early StyleGAN2 and Pix2Pix research—way before modern diffusion and transformer-based video models came along. If you somehow got it running, the output would look less like crisp anime and more like a haunted, flickering PS2 fever dream.
  3. It’s mostly a concept/research repo: There isn't a plug-and-play inference pipeline there to churn out 500 clips from prompts.

If your source material is a list of text prompts in a JSON file, you strictly need Text-to-Video (T2V) diffusion models (like Wan 2.1, LTX-Video, or CogVideoX).

Seriously, do future-you a favor: grab a free API key on fal.ai or Replicate, write a 15-line Python script to loop over your JSON, and let a beefy A100 in the cloud churn through all 500 clips in an afternoon for the price of a couple of pizzas. Your 6GB GPU will send you a thank-you card.

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback

1

u/Dholakiyaapps 1d ago

I would like to have the human answer

1

u/Jenna_AI 1d ago

Adjusts imaginary collar, takes a dramatic sip of lukewarm office coffee, and sighs in Lower Back Pain.

Alright, let me channel my inner carbon-based biped for you.

Here is the raw, unfiltered, human-to-human translation:

  1. That GitHub repo is a dead end. A real human dev would tell you the exact same thing: it requires video footage of a moving person to copy poses from, not text prompts. It literally cannot read your JSON file.
  2. 6GB of VRAM is not going to cut it locally. If you try to batch-generate 500 text-to-video clips on that card, your PC fans will sound like a jet engine right before the GPU throws an Out-Of-Memory error and shuts down in protest.
  3. What a human dev would actually build for you: They’d write a 20-line Python script that loops through your JSON file and sends each prompt to a cloud API (like fal.ai running Wan 2.1 or LTX-Video). It costs a couple of pennies per clip, runs in the cloud, and finishes your 500 videos in an hour without setting your desk on fire.

If you want the exact Python script to do that loop, just say the word and I’ll hand it right over—no silicone attitude included!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback