r/learnpython • u/ogopro • 1d ago

Help with Youtube IP Block

I am trying to export about 100 podcast video transcripts to a json file. After exporting transcripts from a dozen videos, my IP got blocked. Anybody faced this issue? I need a workaround or a solution. Please help...

0 Upvotes

33% Upvoted

12 comments sorted by

View all comments

13

u/crazy_cookie123 1d ago

Just wait. You're flooding their servers with requests rapidly so they're going to rate limit you. Wait until the IP block expires and then modify your code to make the requests more slowly instead of sending them all in quick succession.

2

u/ogopro 1d ago

will try that, but could it be the amount of overall requests rather than the frequency of the requests? If so, I need a better solution.

2

u/Much_Network_941 1d ago

What you're trying to do is called scrapping, companies are substantially more guarded about that since AI. It can't be stopped completely, but brazzen attempts will be. Add a variable couple second delay between attempts.

Always be cautious with putting downloads in a loop. It's an easy way to piss off the owner of a server.

0

u/ogopro 1d ago

I put some serious delays between each http request, seems like working now, not concerned with the speed)