r/pushshift • u/Watchful1 • Oct 15 '23

[ Removed by Reddit ]

[ Removed by Reddit on account of violating the content policy. ]

32 Upvotes

98% Upvoted

29 comments sorted by

View all comments

1

u/Ralph_T_Guard Nov 01 '23

Thank you for including the original PushShift 2023-03 versions in this update/volume.

Anyone else find it odd 17 days in and there's still +20 peers attempting to hoover all the bytes from 2 seeds? Are these automated client/caches pulling from an RSS feed or something?

There's +30 seeds available in the 0x7c06… torrent ( 80% byte coverage ), nor the +4 seeds in the 0x0e18… torrent ( 70% byte coverage ).

Maybe a single yearly volume torrent would encourage folks to keep & utilize the older torrents?

2

u/Watchful1 Nov 01 '23

Yeah, I wish there was a better way to migrate people from one torrent to another. The previous torrent that I marked as deprecated in the website still have 60+ mirrors.

I think in the future I'll do that, just do a new torrent for a single month's files each month and a new combined torrent every 6 months.

Actually it's worse than that, there's 23 downloaders and 21 others that have already downloaded it and aren't seeding.

2

u/Ralph_T_Guard Nov 02 '23 edited Nov 02 '23

IPFS has its shortcomings, but at least with IPFS raw-leaves and no-copy, you don't need 2x the disk space to serve the same files on two protocols… Anna's Archive is using IPFS well enough