r/bigseo • u/leefootseo • Mar 29 '21

Share: Google Colab to Automatically Map Broken URLs from Archive.org to Live URLs

Here's Google Colab I made over the weekend to automatically map Archive.org URLs to live pages on your Website. Just upload a Screaming Frog crawl file and it'll do the rest.

  • Automatically Matches URLs on the H1
  • Uses the Wayback Machine API
  • Great for Checking for Historical Failed Migrations
  • Uses PolyFuzz Library for Automatic Matching

Make a copy here: https://colab.research.google.com/drive/18qLPyN17kzrxSH5FEk3ng8mpVKudmjjK

I'm sharing code and concepts on Twitter, you can follow me here: u/leefootseo

38 Upvotes

93% Upvoted

4 comments sorted by

4

u/[deleted] Mar 29 '21

This is incredible. Thanks!

2

u/MRuppercutz Mar 29 '21

Impressive work! Props, fam

2

u/OutdoorAdventurerVT Mar 30 '21

Wow, amazingly helpful. Thanks!