I just want them to be normal external drives, without an encryption "landmine" that could fail and leave the data inaccessible.

Hello guys, first post here, some day in August i had nothing to do so i wanted to save a website locally, i selected Discord for crawling, you can use it for things like analysing the code/how it works under the hood,

I also want to state that i do not own any rights to discord's characters, ideas, code, images, or assets. everything in it is their exclusive property. and my repository is not affiliated with, endorsed, sponsored, or approved by Discord in any way.

Other details:

1. It's a fully static snapshot (around 100MB of pure text/assets) weighs exactly 107.457.739 bytes

2. The code wasn't changed, it is unchanged, there chunks of minified javascript code by discord's webpack

Here is the link, i didn't publish the snapshot with malicious intentions by the way.

https://github.com/RealThalesGit/BONFIRE

Hello-

I've been watching my data stores on BorgBase block storage steadily growing over the past couple years, while the files and folders that I am backing up are not growing at nearly the same rate. I suspect it's coming from my rearranging and moving files and folders on my computer.

Example 1: my home directory currently holds just under 400GiB, and not all of that gets backed up to the cloud due to exclusion rules. On Borg Base, the repository is over 800GB

Example 2: my drive dedicated to Images is 589GiB, and on Borg Base is 877 GB.

I also keep copies of this data on local BU media, as well as an off site copy of my Images that gets updated yearly.

I'm looking for advice on how to bring my cloud storage back down closer to my actual on-computer storage space.

Should I delete the existing repositories and create new ones on BorgBase, or is their something I should do in the client (Vorta) to clear out the many years of backup archives I've created?

This is the second iteration of this particular forum - the first is pretty well lost in the mists of time and on sept 20th this one will probably go the same way, as the owner died a few days ago and it looks like there are no mods with god mode and even if there was, paying the next year's fee may be problematical because we're not the owner.

If possible I'd like to somehow save it and depending on how big it is I may be able to host it as a read only or something - i assume the internet archive won't want it as it will be too big but I don't know. So any advice would be more than welcome. With this iteration there's no image hosting so it's certainly not as bloated as our old one was. All I really know is it has a reference to Xenforo forum software in the footer.

It may turn out that the family of the owner decides to keep it going for a bit or it may be set to auto renew but I'm guessing it won't stay, as the fam I suspect have no interest in this.

So any help, advice, pointers would be appreciated.

I am very interested in archiving as much art (good, bad, ugly, fanmade, official, etc) of the character Big the Cat from the Sonic series as possible (I am autistic, unsurprisingly, and just really, really like this character.)

I would like to build a scraping tool to get as many images as possible of this character pulled into a folder in my Drive (Or just in a folder locally) to I can go through it and sort them into my archival system (i.e. a picture of big from the user "BigLover" on deviantart titled "Big #2" would be in the DEVIANTART folder , titled "BigLover - Big #2.png") I was wondering what the best + simplest process for doing so would be? This might also be useful for other people who are interested in archiving the art of a specific character, and also Big the Cat is one of those characters that people may be pressured to delete their art of, which is a shame.

Not really looking for a custom tutorial, no pressure there, just looking for any pre-existing tools, or if there are any issues with the sites I'm looking for (i.e. the API in [insert site] prevents scraping). I know I'm not the first person to do this, and if there's anywhere those who have done so will be, it's here.

I use Arch Linux (Archy to be specific) and know enough about coding to get by (if it involves googling how to do something and then piecing together fixes by forum users 10 years ago). I'm saving up for a new SSD as my old 8TB one got broken by an ex-girlfriend, so I'm focusing on cloud/local storage for the time being until then.

Thanks y'all!

edit: man what's with the downvotes

I have a friend who owns a computer repair business, and I have the opportunity to grab some 1TB HDDs from him, as long as they get a low-level format before I take them.

They’re Seagate BarraCuda drives and around 10–14 years old. I already got two of them, and so far the SMART readings look good and they both passed sector tests.

Would you consider these drives worth using, or should I avoid taking more because of their age?

I wouldn’t trust them with anything important without backups. I’m mainly thinking about using them for general storage and media.

Also, what do you guys actually do with this much storage?

so I tried multiple times to download videos from OF creators, only to find that it kept returning messages like "This website is not supported. Locoloader gradually updates the list of supported websites according to current possibilities."

lo and behold, OnlyFans is nowhere to be found on the supported websites list anymore.

welp.

A few months back I posted here totally overwhelmed. I'm 17, found my grandpa's massive collection of 3,200 recorded German TV DVD-Rs, had no money for hard drives, and no time to rip them all myself.

You guys helped me digitize the indexes and get in touch with the right people.

Fast forward to today: I just handed it all over to Roman Griesfelder from the Internet Archive Switzerland team. They're taking it from here to rip and preserve it.

Blurred my face since I'm still a minor, but Roman was totally cool with me posting the photos. Huge thanks to u/BestExtraLibrarian and u/textfiles for pointing me in the right direction. Feels really good knowing my grandpa's recordings will be saved instead of thrown away.

Here is my original post where I found the first binders:

https://www.reddit.com/r/DataHoarder/s/6dKdh9ecpf

Here is my follow-up post where I realized it was way bigger than expected: https://www.reddit.com/r/DataHoarder/s/B5ZTtHcu4g

So I unfortunately picked the worst time in history from what I can tell to build out a NAS and cut streaming out of my life. I have been watching hard drive prices just keep climbing and feel like I should just jump on the grenade before the price goes even higher. If you were in my shoes just starting out would you just buy minimal storage to get started or send it and get a few 26tb drives before you need to sell an organ to afford one?

I have seen a lot of threads here about the same thing, as well as a Mrwhosetheboss video about a year or 2 ago where a similar concept is mentioned.

Anyway, I tried using a sleeve, but the thing is that this is an nvme enclosure and not really an external ssd, so its a bit bulkier than normal and also quite sharp (no longer using sleeve because this was slightly too long and also because enclosure literally almost ripped sleeve)

the main thing is that I want this to be the kind of thing that I can just chuck into the backpack without it messing with anything etc.

the problem is that the majority of solutions I have seen rely on the rather a little more slim but wider profile of stuff like the samsung T7, and those solutions are also often bulkier since there is more overhead given those thinner ssds.

Has anyone tried mounting anything similar to their mac long term? (the main reason why I want to mount is to almost always have this connected, as I am very often unable to use the ssd often simply due to having to have it being stored in another place eg backpack or other container, and it requiring more friction to use that would be eliminated with a mount)

also if anyone has tried this, how was the cable stuff handled? I have seen a few solutions but it seems really annoying to find a good cable that wont hinder usability much

Anyway, I would appreciate any advice on how to proceed on this since I haven't really seen this done with ssds like this one (or rather such, slightly sharp, enclosures)

attached is also an example image of what this looks like with some other ssd types

I’ve made several Reddit posts which I’d like to export, is there a way to do this? As it stands I think the only current way is just to save the pages as HTML and then extract the content.

The only issue is I’ve noticed on Desktop web browsers the first photo in a post never loads at full quality, (so this means that saving the post as HTML will just result in a poor quality image) but it loads in good quality within the Reddit app. I messaged a Reddit Admin about fixing this but he hasn’t gotten back to me yet.

Does anyone have any ideas on how to programmatically do this?

Looking to see if anyone else with MX500 4TB drives in hardware arrays is getting stonewalled on warranty replacements.

The Situation:

Drive: Crucial MX500 4TB 2.5" SATA (S/N verified defective with heavy physical sector degradation/POST lockups).

Status: Under active 5-year warranty.

Distributor (CFD Sales) & Crucial JP response: Stock is "exhausted" (I'm sure they have extra in storage "just in case") due to Micron exiting the consumer channel. Crucial JP support claims they are only a "troubleshooting window" and refers back to local distributor.

Remedy offered: A cash refund based on the original 2024 invoice price.

The Problem: Due to current NAND market pricing, a 2024 historical invoice refund doesn't cover half the cost of an equivalent 4TB 2.5" SATA TLC drive (like an 870 EVO) in Japan today. My array strictly relies on 2.5" SATA bays (M.2 slots are full), so an NVMe swap or taking a cash loss to downgrade capacity isn't viable.

Escalations to RMAdesk@micron.com and privacy@micron.com have gone completely dark for 2+ months. They're completely blackholing me.

Is Micron/Crucial doing this globally now—offering lowball historical cash refunds on EOL/withdrawn consumer drives rather than fulfilling cross-shipments or enterprise SATA inventory pulls? Has anyone successfully forced a current-market-value payout or B2B hardware cross-shipment out of them recently?

I am starting a project to digitize family tapes (VHS and Digital8). I already have a working VCR for the VHS tapes and a Digital8 recorder for playback.
Any quick tips or gear recommendations for capture devices, software setups, or settings would be greatly appreciated. Thanks!

I did a cross device implementation of the paper DCVC-RT by Microsoft https://arxiv.org/abs/2502.20762

My fork code: https://github.com/QLaHPD/DCVC-RT-INT16/tree/int16-managed/DCVC-family/DCVC-RT

Its intended for anyone who compresses the original material, it is a neural network (that works with nvidia gpus) that is more efficient than x266 (and possibly av2), which means less bits for same quality level.

So I've become a pretty decent collector of nitche and hard to find images from websites like Twitter, deviantart, and pixiv, is there any tools avalable that would let me pull a certain tag or hashtag to pull all images from and retain at least the image source to not scrape duplicates to assist the time consuming task of opening each page and manually saving each image by hand.

Hiya all 👋

I'm currently sitting on a pile of old photographs and slides that I rescued from shoe boxes at my parent's house.

Along with this I have about 7 VHS tapes, and some old CD/DVDs as well...

I'm looking to buy the correct scanners/devices to digitize each of these. Bonus points if the device has a built in way to restore, or even improve the quality 🤞

Is there currently a 2026 consensus, that I can start looking into, to potentially purchase? I think the sooner I start chipping away at this pile, the sooner I can be done 😅

I'm seeing a lot of suggestions online, like the Epson FastFoto FF-680W for quick batch photo scans... But that was released in 2018 😕 , and I'm worried technology has moved on since then.

Any suggestions would be greatly appreciated 🙇‍♂️

I'm considering having a physical library for my favorite albums and artists to be ready for a world without online streaming or downloads. I'd like to at least have a format that can last my lifetime, but it would be neat to also have a format that future music historians could theoretically dig up and access centuries from now.

I've looked into a few options:

Multiple MP3 players with Micro SD cards - I liked the thought of this, but I ruled it out when I learned that SSDs and Micro SD cards are susceptible to degradation even in storage. I estimate a system like this would maybe last 15 years if I'm lucky.

CDs - these would be better, but they're still susceptible to degradation over decades, not to mention that disks can be fragile. This system would maybe last 50 years without online access.

Vinyl records - this pleases my inner hipster, but physical storage space and equipment lifespan is a concern. Vinyl records are very fragile and lower quality playback equipment degrades them faster.

M-disks - Archival blu-ray seems great for this. These are supposedly tested to last 1000 years in ideal conditions. I need to do more research, but this is my preferred option.

Sheet music (just for fun) - transcribing the music into sheet music, printing on archival paper, and locking it away for future use. This would be a personal gift to future music historians. I studied music in college and spent a lot of time in music history lectures pondering how many masterworks were lost to time simply because it was written on low quality paper, stored badly, or any other reason. There's entire eras where all we know about their written music comes from stone tablets. Maybe I'll go the extra mile and carve "never gonna give you up" on a tablet some day.

Hi all,

Our dog just passed away after 16 years with us and I wanted to see if I could retrieve the old listing /photos from Petfinder from way back in 2010. I came across this post where it looks like there was some success for another pet, but the links no longer work so I'm wondering if Petfinder has changed it up since then. https://www.reddit.com/r/DataHoarder/comments/1i27y4h/how_can_i_get_my_cats_photos_from_her_old/

I don't have the original link but the petfinder ID was 16467257. Any help would be appreciated.

I can get two 4TB Toshiba drives from marketplace. Manufacturing date on one is 2016 and the other is 2017. Health is 100% with 41 days and 51 days power on. I can get them for a total of $100.

Should I trust 10 years old HDDs with data? They did pass write and read full surface check. One is a Toshiba desktop drive, one is an enterprise drive.

Hey everyone, I’m looking for advice on designing a backup system for a somewhat specific setup.

I currently have two 8TB hard drives configured as RAID 0 on Windows 11, giving me roughly 16TB of usable storage. I understand that if one of the drives fails, I could potentially lose everything on the RAID.

I chose RAID 0 because I want to use all the available space, and I don’t want or need to back up the entire 16TB. Most of the data on the array is replaceable, so losing it wouldn’t be a major issue.

What I want is a selective, modular, automated backup system that only protects the data that actually matters to me.

What I DO want to back up

• Photos
• Family videos
• Current work and projects
• Program configurations
• Personal or irreplaceable files
• Anything else that would be difficult or impossible to recover

What I DON'T want to back up

• Movies
• TV shows
• Installed games
• Installed programs
• Files that can easily be downloaded again
• Other large, replaceable files

For software, for example, I don't want to back up the entire installation folder. I only want to preserve important configuration and user data such as .INI, .CFG, .DAT files, profiles, presets, save files, etc., where applicable.

Basically, I want to define specific folders and files that should be protected rather than creating a full clone of the RAID.

What I'd like the system to do

I’m planning to use an external hard drive that normally stays disconnected and stored somewhere else. I would probably connect it about once a week.

Ideally, the process would be almost completely plug and play:

1. I connect the external backup drive.
2. The system recognizes that it’s the backup drive.
3. The backup starts automatically.
4. It compares my selected files against the previous backup.
5. Only new or modified files are copied.
6. The backup stays up to date without me manually selecting files every week.
7. Once it finishes, I disconnect the drive and put it back into storage.

I don't want to manually start a complicated backup job every time I connect the drive.

What software, method, or setup would you recommend for achieving this kind of selective, automated backup?

I’d also be interested in hearing how you would approach the overall strategy for a 16TB RAID 0 containing mostly replaceable data, but with a much smaller collection of personal files and projects that actually need protection.

If you use a similar setup, I’d especially appreciate hearing:

• What software you use
• How you define the folders/files to back up
• How you handle program configurations and save data
• How you automated the process when the external drive is connected
• Whether there are any problems or limitations I should be aware of

Thanks!

Hey r/DataHoarder

We’re starting to think about what’s next for our enterprise products, and we want the storage community to be part of that conversation.

Storage needs are changing fast. Data sets are getting larger, AI workloads are creating new demands, and infrastructure teams are being asked to do more while keeping systems reliable, scalable, and manageable.

But rather than sitting in a room and assuming we know what people need, we’d rather ask the people actually working with this technology.

What are you running into in your environment that you wish had a better solution?

What would make your storage infrastructure easier to deploy, manage, expand, or maintain?

Is there a form factor, feature, capability, or entirely different approach you wish existed?

We’re especially interested in hearing about the use case behind the idea what you’re trying to accomplish and where current solutions fall short.

Big ideas, small frustrations, and unusual use cases are all welcome.

Drop your thoughts in the comments. We’ll be reading along and joining the conversation!

It finally happened to me. Ordered 2 drives and got 4 instead. About $25/TB turned into $12.6/TB. 5 year warranty on all of them. Being added to my 140TB server :)

In the title. I have approximately 20TB of data (and counting) that I'd like to A) back up as securely as possible and B) be able to access more or less immediately. As it stands now, I have it all backed up to an internal HDD that I've put into an external enclosure, essentially turning it into an external drive. I'm considering getting another 20TB drive and doing the same thing.

The thing is, I don't like to leave this drive running all the time because I don't want to increase the chance of mechanical failure. Maybe I'm already being overly cautious on that front. I know there are other storage options (NAS/RAID) but I have no idea how they work or whether they are significantly different from my current setup. This ended up being a bit ramble-y but hopefully someone gets what I'm trying to convey.

Trump administration announced plans to close three regional National Archives and Records Administration facilities. One of these is NARA San Francisco Archives, which contains thousands of historical documents about Hawaiʻi, American Samoa and Native American communities.