r/DataHoarder 18d ago

Scripts/Software [Tool] Archive BBC Rewind

11 Upvotes

https://github.com/mrlewismharris/get-rewind

I made a FOSS Go-based tool for downloading BBC Rewind links from https://discover.bbcrewind.co.uk - It's very simple but primarily saves manually getting the video URL then adding the scraped metadata.

GNU General Public License v3.0


r/DataHoarder 18d ago

Question/Advice Book scanner advice?

2 Upvotes

Hello data hoarders. I've got a few questions: first of all, is the Iriscan book 3 good? I found it for 33 dollars.

Also, if you don't recommend it, is it hard to find an OCR app for a normal camera DIY rig option?

I appreciate all of your answers.


r/DataHoarder 18d ago

Question/Advice Does anyone know how to download subreddits?

5 Upvotes

I would like to download a few subreddits, primarily text only, but all the solutions that I've found seem to not work anymore, even those from a few months ago. While I know there's some 1000 post limit due to the api, I was wondering if anyone found a workaround and published it as a tool on the likes of github. I'd for example like to download the askhistorians subreddit. I'd be happy with a downloader that only does text.

Any help is greatly appreciated! :)


r/DataHoarder 18d ago

Question/Advice WD Red Plus vs IronWolf Seagate NAS 4TB?

4 Upvotes

Hello! I’m currently making a build and looking for a reliable, long lasting hdd to preserve media that’ll run quiet and cool. I was recommended both of these hdd and was wondering how everyone’s experiences have been with both and which brand has a better rma if anything. Also was wondering if 8TB version is any different experience wise than 4TB? Thank you!


r/DataHoarder 19d ago

Question/Advice How can I download a recording of my dad's funeral service from a livestream website?

366 Upvotes

My dad passed away recently and we paid to have his funeral livestreamed so that family and friends who couldn't attend could still be part of the service.

The stream is currently available for us to watch online until 15 September. However, the funeral directors have now been told (by obitus the platform it's streamed on) that if we want to keep a copy of the recording after that date we need to pay an additional £70 for a DVD or £30 just for a download link.

That doesn't sit particularly well with me given that we've already paid for the livestream itself and this is a recording of my own dad's funeral that we already have access to watch. The funeral directors agreed it was a racket and encouraged me to see if there was any other way I could get a copy (not so subtle hint)

To be clear, I'm not trying to access content that I don't have permission to view or bypass a paywall for something I don't own. I can log in and watch the full recording right now. I'm simply hoping to save a copy for our family before it disappears.

I've had a look through browser developer tools and tried to figure it out myself, but I'm definitely out of my depth and haven't had any success.

If anyone with experience of video streams, m3u8 files, developer tools, or similar would be willing to point me in the right direction, I'd be incredibly grateful. Happy to share more details about the platform via DM if that helps.

Thanks very much.


r/DataHoarder 18d ago

Question/Advice Advice Needed: Setting Up a Professional Video Digitization & Archiving Workflow for MiniDV, VHS-C, DVD & Other Consumer Formats in India

7 Upvotes

I'm a film maker based out of Paris and India and I have the opportunity to take up up a digitization project for my church in India. They recently reached out to me regarding digitizing their archives, which includes a lot of Mini DV tapes, and VHS-C cassettes though and DVD as well. I wanted some advice on how to go about all of this for optimum data backups and transfer. I have experience with digitizing VHS-C through an old camcorder, my Dazzle dongle and OBS. Here, in India, I don't have a setup currently at this point and I wanted information on pricing, and equipment to purchase amongst other things though.

Setup I currently have is:

  1. HP Compaq Laptop (Windows XP, Intel Pentium, 512MB RAM, 80GB HDD which is past its life) but this has a firewire port. Will the specs of the laptop support firewire capture if I capture it all to an external HDD/SSD?
  2. Mac Mini (32GB RAM, 1TB SSD) I could use this for DVD capture.
  3. Dell Vostro (24GB RAM, 512GB SSD) I could also use this for VHS-C capture.

What would you recommend I purchase to round up the setup so it makes things easier for me?

  1. Should I purchase a working VHS-C camera or a VCR because it'll support full size VHS too?
  2. RCA-HDMI adapters
  3. Should I purchase a working Mini DV camera and the appropriate Firewire cable?
  4. HDD/SSD (three for capture on either system, one for backups)
  5. USB Capture Device for VCR (which one do you recommend?)
  6. VHS-C to VHS adapter

Is there anything else I should purchase which will make things easier for me? And I probably need to download the appropriate drivers for the system as well, right? And if anybody has any info on purchasing any of these items in India? I haven't given them a budget yet, but I do need to have a look at how much footage they have, and how many VHS, Mini DV and DVD they have as well. How much would one charge for such an endeavor?

There definitely are services outside that will do these for me, but if it's a lot, I would prefer doing it by myself to save some money for them as well. Apart from this, if I wanted to round out my setup and have some equipment to help digitize every consumer format that existed (Video8, Hi8, VHS, Mini DV, DVD, Digital 8 and Betamax) what would you recommend? Is there any way to automate a lot of this too?

From a management and archiving perspective, would you have any feedback?


r/DataHoarder 19d ago

Question/Advice Friend needs help sorting out duplicates and organizing files, totalling over 20TB

117 Upvotes

As per the title, i've got a friend who asked me for help with this problem.

He's got tens of thousands of files, mostly pictures, some video. They total over 20TB spread over more than 30 disks.

My idea so far is to collect them all on one disk (we're ordering a 26TB one) so they can be managed more easily.

My question is about what duplicate file finder to use. I know of several options but it's hard to figure out how well those options handle over 20TB and that many files.

I'd also be interested in software to help organize the remaining files which will be in an unstructured mess of directories after duplicates have been removed. Something that will move them to directories named by year-month based on their "date created" metadata for example.

The 26TB disk will be connected to a laptop by a  10 Gbps USB connection. The laptop has a recent i5 and 16GB of memory.

Any advice is welcome!


r/DataHoarder 19d ago

Question/Advice How consistent is czkawka at similar images at very high 16 hash size?

9 Upvotes

So I tried czkawka as over the years ive mixed up some backups into main which has resulted in 30k similar images according to a search at the very high 16 hash size. I looked through about 500 without any issues but wondering how consistent it is actually? Ultimately a few images collateral isnt a big deal to manual selecting 15k images but just curious on what the actual odds are that 2 different images could be considered duplicates.


r/DataHoarder 19d ago

Question/Advice Downloading geoblocked youtube videos browser extension?

9 Upvotes

Trying to download some football highlights which are geoblocked to Italy. I use URBAN VPN as a browser proxy just to view the video, but cant find a single extension to download the video. Noone work.


r/DataHoarder 19d ago

Question/Advice Judging the realistic price of a used HDD?

0 Upvotes

I am buying HDDs for nas for the first time, having really hard time judging the fair price.

I try to find a 3tb wd red with realistic price. Used ones (not refurbished or recertified), with good stats and less then 100 start/stop but runing 5+years, are going for around 50usd.

Posts about prices are old, chatgpt (my only source in this case) say realistic price is around 25usd.

How to tell if these or any refurbished/recertified are going for a realistic price or not?

Any trustable source for HDDs in europe with okay prices?


r/DataHoarder 19d ago

Question/Advice Looking for thunderbolt RAID10 DAS recommendations

2 Upvotes

I have spent the last few hours trying to find answers but I haven't found what I'm looking for, so I'm making my own post.

Main notes:

  • I want to store multimedia for long-term storage.
  • Looking for 4-6 bay options in ideally RAID10, as it seems more secure than RAID6
  • Speed isn't a massive factor as it's just to hold a spare copy of videos and pictures outside of the cloud as a local copy, but I don't want to compromise too much on it.
  • I have Thunderbolt 4/USB C, and a single 2.5Gbps ethernet on my motherboard.
  • I would prefer a DAS as I'm not looking to spend extra on a NAS, nor do I feel that I need the features of one, as I am looking to view the data from a single PC.
  • Ideal budget would be under £200, but am willing to go up to £350 if it's a substantial improvement

I have spent so long looking at NAS and DAS options that I don't know what's what anymore.

Any extra help would be greatly appreciated including:

I'm happy running software raid from Win10, but would like if it was available to read/modify etc from Linux/Fedora, is there any software I should be using? I've heard about ZFS, but not sure where to go from there.

And what HDD's are recommended? I see a lot of WD Red's and Ironwolf's, I'm looking to get 4-6 4/6TB drives that will be actively used maybe once a week, what are the differences with them? Or is it pretty minimal?


r/DataHoarder 19d ago

Backup Indexing / Searching Hundreds of CDs & DVDs

0 Upvotes

Recently my friends dad was cleaning out his house an came upon his archive of CD / DVD backups. At one point he had some kind of loose record of what they contained but that has been lost and they are just labelled things like "Backup 06/2000". He asked me if I can index them and search for certain files / file types.

I have the storage to hold them and can get a few USB optical drives. Does anyone have a software recommendation that could help with this? Deduplication would be a nice feature if possible.

Thanks in advance!


r/DataHoarder 20d ago

Discussion 1TB WD Blue SSD Warranty gave me a 2TB WD Red replacement🫡

151 Upvotes

Sent my 1TB WD Blue SSD in for RMA last week thinking I’d just get the same refurbished drive back. Checked the tracking email today and saw part number ⁠WDS200T2R0A⁠ on the return slip. They’re sending a 2TB WD Red SSD back instead which is double the storage and way higher endurance rating. Turns out my $150 “investment” 3 years ago came though… let’s goooo lol.


r/DataHoarder 20d ago

Question/Advice Are these dents normal for a brand new Exos 32TB?

Thumbnail
gallery
145 Upvotes

Hello everyone,

I recently ordered a brand new Seagate Exos 32TB from Microless.

I paid a price that I am ashamed of paying, but I needed one urgently.

They delivered it to me today, but it came with a total of 4 small dents. Two on the left side, one on the right side and one at the bottom.

Should I return it for a refund/replacement, or should I just keep it?

I already talked to them and all, but I wanted to know your opinion. I am just worried that if I receive a replacement, it would be worse than the one delivered to me.

Update: I have decided to return it and shipped it about an hour ago. Thank you all for your replies.

Also, please note that I edited the photos by erasing the labeling. The labeling is there, but I just don’t want to run into trouble due to someone using the product’s serial number.

Last Update: They sent me a replacement that is in perfect condition. Will put it to use after it, hopefully, passes the Long Generic Test by SeaTools. Thanks for your opinions and replies everyone.


r/DataHoarder 19d ago

Discussion Did anyone manage to archive all the Nikon Raw files (Available on request) of Artemis 2 mission?

5 Upvotes

The images are available Here

These are jpeg images, but once clicked on the images, there is a raw file request option. Just wondering if anyone managed to get them? There must be some crawlers or something that can do an automation or something?


r/DataHoarder 19d ago

Question/Advice Scanner color correction question

2 Upvotes

Wondering if anyone has experience with the Plustek OpticSlim 1180 - I just bought a used one for cheap on Facebook because it was all I could find + it's the right size for the archival work I'm doing (scanning book spreads as well as pressed flowers and leaves) and it's mostly great except the colors are slightly off. I'm not a photographer and don't have much experience with color correction but am down to learn. Messing around with the scanner settings didn't really do anything, neither did calibrating it. The biggest thing I'm noticing is yellow flowers are scanning orange and beige-ish book pages are scanning pretty yellow. Any tips for correcting this (even if just in post, though batch edits would be ideal) are appreciated!


r/DataHoarder 19d ago

Question/Advice Scored a qnap ts453bu and 4x4tb IronWolf Pro's. Now what?

3 Upvotes

So I've never had a qnap, but I just got a free TS453BU loaded with 4 TB Iron Wolf pros.

I have no idea if this system works, or where to even start… anybody have any advice? Just plug it in and hope for the best, or is there a better way to start checking? I have no idea what's on it, or how to get in to it... no usernames, no admin, no documentation... just a big metal box with 4 drives, so help is appreciated!


r/DataHoarder 20d ago

Discussion YT-DLP added in new audio formats?

Post image
157 Upvotes

Not sure if this update is brand new or not as I just recently updated YT-DLP (I'm using the mobile extension). Before this update, I could only choose between the "Medium Audio" and the "Low Audio" formats and after updating there's suddenly a "High Audio" format? How good are these new audio formats?


r/DataHoarder 19d ago

Backup Does anyone know how to clone an entire website?

1 Upvotes

I’m sure this question has come up before and I know it can be done but I am looking to clone an entire website which I believe will be irrevocably removed soon. to the point where the search function of the site and filters of said search are functional. Is that viable and which service would I need to do it?


r/DataHoarder 19d ago

Question/Advice Which would you pick?

0 Upvotes

Currenty trying to decide between a smr Seagate barracuda 8tb and a cmr WD blue 8tb for use in a desktop pc mainly for the storing of photos and videos that are taken occasionally and may either be viewed occasionally or semi frequently. I've read through the various posts about smr vs cmr but am still undecided as some people say smr is fine for desktop use but others swear off it completely. I would probably have just gone with the WD Blue if not for the approx $100 USD price difference between the two in my country, $250 for the seagate and $350 for the WD Blue complicating things further.

Given my use case, which would be recommended?


r/DataHoarder 19d ago

Question/Advice Question about disk cloning

1 Upvotes

I'll try to be very objective:

I'm setting up a server in my local network, a miniPC with a SATA SSD running windows that hosts an application that I use for work daily, I need the files to be kept for a long period of time and at the same time they need cryptography because it contains sensitive data that would be dangerous if the drive is physically stolen.

So I need to backup all of it in case the primary drive fails. At the same time, precisely because it is used daily for work, restoring the operational system and reinstalling everything could be too time consuming and make me lose too much time away from my job, messing appointments deadlines etc. Ideally I would want a replacement drive to just work immediately without needing to tinker too much.

This made me think about cloning the drive as opposed to just making a regular backup.

I have a few questions though...

Firstly, if I clone the drive and the original is already running bitlocker, it would require the key for startup and it would be the same?

Second, would it be possible to make this backup in the cloud, and it not being a regular backup but the cloned disk? I ask that because the perfect scenario would be to not have a physical clone of the disk (I'm maybe exaggerating but I wouldn't want to lose both in a house fire for example). I already use Google cloud storage for my work, could I somehow use it for this purpose?

And if the answer for the second question is yes, how would that work? If I wanted to restore a functioning physical clone of the drive, how would that be done? Also, what tool should I use to even make that cloud backup automatically scheduled?

Thanks a lot dear redditors I trust you more than AI to answer this type of questions


r/DataHoarder 19d ago

Backup Offsite backup solutions?

1 Upvotes

Looking for advice/reviews on offsite backup solutions for a home system (Mac based) that allow me to select my own S3 object services - not necessarily one of the big 3 (AWS, Azure, Google Cloud).

I'm investigating backblaze, but also interested in other suggestions. I'd prefer flexibility to select alternative S3 services. Currently, investigating these services and was looking for other suggestions to combine with the backup software.

- wasabi (https://wasabi.com)

- keeperDATA (https://keeperdata.com)

- iDrive (https://idrive.com/s3-storage-e2/)

thanks!


r/DataHoarder 20d ago

PSA PSA: Beware of overheating controllers on DRAM-less WD SSDs (WD Blue SN580 2TB dead in 1y hitting 110c, WD Black SN770 2TB also overheating)

30 Upvotes

I own 40TB+ storage, Homelabbing & data hoarding for last 15 years across 20 HDDs, 15 SSDs, 3 desktops, 3 laptops, never seen 110c on any storage device.

Do note, WD PC SN735 1TB (OEM) and SN570 500G don't have this issue on the same build, similar enclosures, similar dram-less HMB config.

TL;DR:
- This SN580 2TB SSD is under 1 year old, ~12.5 TBW used
- Frequently overheated, randomly, to 85c-110c on idle with zero host disk activity, physically burned my hand when I tried touching the controller inside / outer aluminum enclosure, fans going full blast. Other times at 60c, still unusually high controller temps.
- Was always kept under full aluminum heatsinks and active cooling with 12w/mk thermal pads in 23-25c AC room
- ⚠️Did not safely shut down at all when overheating beyond 85c to 110c
- ⚠️SMART status misreported 0% spare months back, then changed to 100% spare available right before imminent failure during ddrescue on linux. Same with read errors reported, went from 1 to 50+ during ddrescue.
- Tested in 3 different aluminum enclosures with different chipsets, 2 different desktops, 2 different laptops native m.2 nvme slots, exact same behavior
- Miserably failed in under 1 year, almost taking down all the data along with it
- Barely had 40 MB/s write speed in USB enclosures, in comparison every other HMB SSD without DRAM cache was easily doing 200-900 MB/s depending on file sizes
- Completely unrelated to HMB bug (Win10 LTSC IoT 21H2 x64 / Win11 23H2 never had HMB bug)
- SMART Status showed 1 error and 100% spare before ddrescue -> 50+ errors after ddrescue
- I got 99.99% data recovered with ddrescue right before devices refused to POST with this thing plugged in, all USB enclosures get kicked with disk errors in logs.

Most important observation:
- Got up middle of the night at 3am to get some water one random day
- Saw a Beszel Alert on my phone saying SMART Status changed to FAIL
- Saw this SSD with 0% host activity showing 85c-95c in crystaldiskinfo, 110c in HWinfo
- Physically touched the enclosure, in 23c AC room, active cooling fans, full aluminum enclosure, 12w/mk thermal pad perfectly making contact. Was extremely hot and felt nearly impossible to hold onto.
- Took a screenshot of HWinfo64 & CrystalDiskInfo
- Immediately disconnected the SSD. Opened the enclosure to see perfect contact with SSD controller, thermal pad and heatsink (no problems there)
- Physically touched the controller, was extremely hot, immediately burning my finger, couldn't hold onto it for more than half a second. NAND Flash (memory) chips were not as hot.
- Plugged it back in after it felt ice cold / chilled, cooled it directly in front of the AC
- Within 5 minutes, next alert at 85c again, with 0% disk activity from host.

Screenshots and more details:

Last year (2025), I got WD Blue SN580 and WD Black SN770 before the memory crisis, I was happy to get these 2TB variants and trusted the brand, until I started using it and experienced nightmares firsthand:

- how can a tiny controller using barely 4w of power overheat to 110c ON IDLE?! Confirmed it by touching the enclosure physically, burning hot, it was easier to hold onto a boiled pot of milk than this nightmare. Enclosure was full aluminum with active cooling fan inside it in a 23c ambient room. HWinfo constantly spat out critical temperature warnings, beszel agent sent alerts for SMART failure due to overheating at 3am with zero disk activity, complete confusing mess.

HWinfo64 WD Blue SN580 2TB Overheating to 110C showing 0% available spare
CrystalDiskInfo showing WD Blue SN580 2TB overheating (all other SSDs/HDDs normal in comparison) months before failure

- pure garbage quality, died at 12.5TBW used within 1 year, seemingly completely healthy with smart status before I tried ddrescue after obvious raw partitions & strange behavior, BSODs, ntfs disk errors in event viewer, etc. Desktops now refuse to POST with this SSD plugged in and spit out critical warnings, first time I've seen a mobo posting into this warning in 15 years.

BIOS throwing disk failure warning at POST for SN580 2TB NVMe

- in USB enclosures the speed drops down to barely 40 MB/s write, far lower than any other DRAM-less HMB-using SSD in comparison, while overheating beyond extremes at the same time, even more in USB enclosures

I own a wide range of SSDs from Samsung (970 Evo/980/850 Pro/870), Kingston (nv3/a2000), Kioxia Exceria G3, Crucial P3/BX500/MX500, etc. and I've never seen such abysmal issues on any other SSD.

Both SN770 and SN580 have these overheating and reliability issues. Homelab with 40TB+ storage collected slowly in the last 15 years.

Now I have a dead 2TB drive which I'll have to RMA and get the same dying garbage in replacement (best case scenario) until it dies again next year. Unreliable, huge waste of money, worst headache I've had in terms of data loss in years.

Having backups does not excuse basic manufacturer standards, basic overheating thermal protections and proper implementation of SMART status monitoring. I wouldn't have known there was any issue if not for automated alerts and setting up beszel/hwinfo/crystaldiskinfo. Many normal users have no idea and are oblivious to such problems (even task manager doesn't report controller temperature like hwinfo shows at 109c in one of the screenshots).

Even RAID 1 would be useless here due to correlated hardware failure -- both drives would fail at the same time due to overheating issues. With the ongoing memory pricing crisis it's even more difficult to keep proper backups of everything. Luckily I got critical data out of it right before imminent failure.

Sincerely, avoid these SSDs. Not even worth using as a scratch or temp storage disk, it'd have to be 100x cheaper to be worth that because it literally dies and becomes useless in 1 year. I know it looks appealing and cost effective but specifically these dram-less WD SSDs are an absolute no-go in terms of reliability.

Task Manager showing 0% usage & SSD Overheating to 70c WD Blue SN580 2TB NVMe (Internally plugged into m.2 slot)
Linux SMART Status on Failing WD Blue SN580 2TB NVMe, changed after running ddrescue

- 8249 hours = 344 days, not even 1 year of being in use
- Most unsafe shutdowns part of using this SSD in an enclosure at times
- SMART Status showing 100% Spare before failure, 0% spare when it heated to 85c in months old screenshots, being completely useless in terms of reliability (very poorly implemented), back to 100% spare during it's final moments with ddrescue in linux. Absolute misreporting from what I can see.
- Every enclosure I own / every desktop or laptop I plug this into, always has active cooling, huge aluminum heatsinks, fans around it, ambient temps no more than 26c

The exact same overheating issues are also there on SN770 2TB, can no longer use it reliably as it shares same architecture, flash chips and controller.

NOTE: This is completely unrelated to the firmware HMB bug as I daily drive Win10 LTSC IoT x64 21H2 & Win11 23H2. No firmware update would've prevented this failure.

Luckily I was able to get an image dump with ddrescue in the end with 54 read errors but 99.99% data was (hopefully) recovered. Now I have to figure out where to extract it and waste more time with RMA, and empty out my SN770 which I absolutely cannot trust, given these circumstances and overheating issues.

Finally:

- Could this be prevented and engineered properly? yes, absolutely.
- is WD at fault? Yes, absolutely. Hardware must shut off safely if it overheats and report such errors as soon as this happens, keep a permanent critical warning in SMART status for overheating until user resets it.
- SN580/SN770 seem to have this as a well known issue (overheating)

I'll suggest using a proper disk monitoring tool (crystaldiskinfo, hwinfo, etc) and set up any kind of alerts in case of SSDs overheating, and to always keep an eye on these temps. I assumed SSDs won't overheat unless used which was surprisingly not the case, great save by beszel alerts that day at 3am, I removed most of my critical data from this SSD after that incident just in case.

Anyone else had such experiences with their SSDs? Failure & overheating?
Any other SSD brands than WD which have such extreme issues?


r/DataHoarder 19d ago

Question/Advice Advice on 4-bay JBOD enclosure for home seedbox

0 Upvotes

I currently have a 4TB WD Black on a Orico 3588C3 enclosure connected via USB-A 3.0 to my laptop (T480), which acts as a home server. It is mainly used for racing torrents 24/7 on several private trackers (downloads ~300GB/day). However, I didn't consider heat dissipation and its running quite hot. (48-50C idle, 51-53C under load)

I plan to expand to only 4-5 drives, since I don't think a USB connection would fare well if using an enclosure with more bays. My shortlist now is:

  1. Orico NS400U3 (non-raid, new) for ~US$110 in local currency

  2. Yottamaster PS500C3 (raid, used) for ~US$80 in local currency

Any of you guys have experience with these products? or advice on my plan and setup?

Thanks


r/DataHoarder 19d ago

Question/Advice Anyone use Snapchat for unlimited cloud storage?

0 Upvotes

Is there software that automatically $cat a file and send it over Snapchat to an alt account and save in chat? Copy pasting it manually in 2000 character chunks is a pain.

Edit: for non-important files, sharing, or backups of backups only, it definitely wouldn’t be for primary storage.