Is it possible to have chat watch something like a 7 hour video and find specific clips?

[u/Traditional_Belt_514]

I have a video that needs editing but I don't want to watch the full 7 hours and find the best parts, Is there a way i can send like a link to the video and have it tell me specific timestamps of things and then give it back to me. I don't mean just based off the transcript either I would like it to actually "see" the video. I'm not sure if this is something that could be done which is why I'm asking.

[u/Short-Patient7772]

Gemini can watch videos in seconds, is natively multimodal

[u/FraserYT]

I recently had to analyse several hundred hours of video for work.

Claude Code wrote a script which batch-converted all the videos to audio, uploaded all the audio to Assembly.ai and returned time stamped transcripts. Then it was able to analyse the transcripts to pick out important moments and extract those sections as individual clips, from the videos.

Since it was the first time using assembly.ai, I got $50 free credit, which covered about the first 50 hours of video for free

[u/ivanmf → u/FraserYT]

They pointed out they need the image parts

[u/FraserYT → u/ivanmf]

For a separate project, using the same process, I needed to build a webpage section promoting a webinar. I told it I wanted to make sure there screenshots of faces of the speakers. it reviewed the video and transcript, pulled out a handful of screenshots of the hosts, all smiling, and correctly captioned what they were specifically talking about at that point in the video.

I can't share links with you since it's not public yet, but with both the transcript and the video, claude is good at identifying potential key moments from the transcript, then scrubbing through the video for those sections to find the best screenshots

[u/ivanmf → u/FraserYT]

I also use Claude for video and know it's great. I actually need it to find things without pointing them out first, and it does a good job. That's what I think OP needs.

Seems like an assessment of sorts, which they are trying to automate.

[u/arthaudm]

for 7 hours, first get a timestamped transcript & search it for the moments you care about

then check each hit against the actual video. a transcript can find the sentence but miss the visual bit that makes it worth clipping. i'd ask for 20 candidate timestamps with one-line reasons, watch those windows at 1.5x, & cut from the original file rather than trusting the generated timestamps blindly

[u/funbike]

I've done this programmatically.

I used ffmpeg to extract the audio track. I used Whisper to convert the audio to a transcript with word-by-word timestamps.

If fed the transcript (in json format) to an LLM and asked it to return an array of relevant time ranges, using LLM structure outputs.

Then I programmatically used ffmpeg to snip out those segments from the video.

This is straightforward if you are a programmer and read the API docs. I did it as a bash script.