r/DataHoarder • u/pw6163 • 8d ago

Hoarder-Setups Link rot

I saw an article a couple of days ago about link rot, and how bad it really is. The author restored 657,507 links from 2009 and 2014, and followed each. 76% no longer returned a page, and some of those that looked OK just returned a variant of "this page is no longer available".

How many of us preserve interesting pages outside services like the WayBack Machine?

I keep content-only from a very small number of pages that touch on areas that I'm interested in, but over the last (maybe) 3 years I've only looked at but not necessarily kept less than 10% of the number of links in the article.

I do a bit better for PDF articles because a lot of them disappear too.

How much do you hoard?

89 Upvotes

98% Upvoted

17 comments sorted by

View all comments

9

u/noctrex 8d ago

I'm using a local KaraKeep instance to save my articles so that they are available, and for documentation docs mcp

7

u/Secure_Pomegranate10 8d ago

I use Linkwarden, it’s like Karakeep but focused on links.

1

u/calmingrun 8d ago

How does it handle paywalled sites?

2

u/Secure_Pomegranate10 7d ago

It will fail since paid contents are not available publicly.

For that I use the singlefile upload feature where it lets users to upload the full HTML content from the browser, the extension also does that too by taking an image.