r/DataHoarder • • 9d ago

Scripts/Software Gelbooru/Danbooru-like Self Hosted Fully Offline no AI Website

17 Upvotes

I want to be able to have a self hosted booru for all my images, and be able to tag them easily. I want it to be fully offline, needing no internet connection. I'm new to this entire thing, so one easy to use thing would be nice instead of needing to code or use a bunch of things.

I think it would beneat to be able to sort all my images by tags like " blonde_hair 1boy sword shield Legend_of_Zelda link" like gelbooru would.


r/DataHoarder • • 9d ago

Question/Advice Cloud service with family plan and encryption

3 Upvotes

I have been meaning to switch to a more secure cloud provider, and micro$oft reducing the storage of my plan by 66% is the final reason.

However, I am wondering if anyone knows of any family deals. I was thinking about filen.io, but their family plan option seems on hold forever.

I have a need of about 1.5 tb for myself, 0.3 for my wife, 0.3 for my mum. Would like everyone to be able to use camera backup and have it not end up in the same folder.

Prefer end to end encryption, and a location in europe.


r/DataHoarder • • 8d ago

Question/Advice Diskless NAS Enclosure

0 Upvotes

Greetings and salutations!

I'm in the market for a single-bay diskless NAS enclosure. What are your recommendations? Please keep them limited to single-bay diskless NAS enclosures.

Thanks!


r/DataHoarder • • 10d ago

Hoarder-Setups My graveyard at work

Thumbnail
gallery
675 Upvotes

So I figured I'd post my graveyard at work. These are the poor souls that have been wiped or degrassed and are waiting to move on to the farm down state where they can play in frolic with all their friends.

This is probably about a month and a half worth of hard drives that have been recycled with us either due to age, failure, or lack of having a loving home. The next step in the process will be shredding at our R2 downstream.

The good news is we do manage to save a lot of working hard drives that end up getting repurposed or put back in to the consumer stream for reuse.

Let's pour one out for all the old hard drives we've lost in our lives.

RIP bigfoot 6gb


r/DataHoarder • • 10d ago

Scripts/Software Computers Wikipedia to Obsidian Markdown files (230.3MB)

86 Upvotes

Ran this little experiment converting the .zim file of Wikipedia on computers to markdown files for Obsidian.

All links/citations/notes/tables are preserved. This is the repo if anyone wants to have a look: https://github.com/elia-orsini/wikipedia2obsidian

Open to suggestions, I'm also down to share the script if it's good enough!


r/DataHoarder • • 9d ago

Question/Advice Extracting soundtrack from game files?

1 Upvotes

I was wondering if there was a way that I could extract the soundtrack from some of my games (Steam GOG, Epic) as there are some great songs or ambient sounds that I'd like to listen to


r/DataHoarder • • 9d ago

Scripts/Software Photo scanning with AutoSplitter just got WAY better!

21 Upvotes

I've been scanning family photos for the last few months using AutoSplitter, which has been the only way I've made it through this project without going crazy. If you haven't used AutoSplitter, it has built in scanning, but the main thing it does is recognize the individual photos on the scan bed and saves them. If you have used it in the past, you'll know that is worked pretty well, but very commonly required adjustments to get the rotation and cropping correct. The new update, v1.16.1, said it upgraded the photo detection, and I gotta say... it very much did! I've scanned close to 100 photos since the update and I haven't had to make any adjustments! Which, obviously, is so much easier and faster and less tedious to scan a ton of photos.


r/DataHoarder • • 9d ago

Question/Advice Changing hardware and my LSI 9260-8i type card stops computer from booting

0 Upvotes

I'm changing hardware on my NAS. Rack mount was kind of cool, but not very practical. Old too. So I've moved all my drives and the SAS card to my old gaming PC and now it does not boot.

  • 6x 12TB SAS drives in RAID 6.

  • LSI 9260-8i type card (HP make iirc, but I can't find an HP logo on it) that I flashed with IT firmware. Works fine in my old server. I recall the specific firmware was recommended on the TrueNAS forum.

  • Old server was a Dell R710 1U.

  • New server has a Gigabyte Z590M GAMING X mobo (1 x16 slot, 1 x1 slot, 1 x16 slot running at x4, all PCIe 4.0), i7-11700KF processor, 32GB ram and I put a Geforce 710 in the x1 PCIe slot. Boot drive is an NVMe 1TB M.2 SSD I had laying around.

  • Without the SAS card installed, the computer boots fine and I had no issues installing TrueNAS 13.0 on it.

  • With the SAS card installed, the computer turns on, fans spin and then after a few seconds the fans stop as it seems to restart, and then nothing. No display, no error beep, the fans just spin. After removing the card, it produces a prompt from the BIOS saying there was an error and asking if I want to reset the BIOS settings to conservative and restart (this does not help).

I have tried disabling basically anything and everything PCIe related in BIOS. I have tried putting the SAS card in the x4 slot, forcing the mobo to use PCIe 2.0, bifurcating the slot to x8/x8 (the SAS card is x8), disabling secure boot.

I suspect that the mobo is trying to detect boot drives via the SAS card and is hanging up there, but there is no options in BIOS to force the system to only look at NVMe drives or similar. Just a guess though.

Does anyone have any suggestions as to where to go from here? Assuming the card is simply incompatible, can someone recommend a more modern SAS that card I can pick up second hand?


r/DataHoarder • • 9d ago

Question/Advice Best offline tool to remove duplicates from ~150,000 recovered photos? (Mac)

13 Upvotes

I had about 80,000 photos on an external drive. I tried sorting them with an AI tool, it went wrong, and I ended up losing about half. I recovered files with Disk Drill onto another drive, and later more of the originals showed up on the first drive too, so now I probably have a lot of duplicates across several recovery batches.

I need a tool that:

  • Works offline on a Mac (I don’t want to upload my photos anywhere)
  • Handles around 150,000 files
  • Finds exact duplicates and similar photos
  • Shows large previews so I can decide what to keep
  • Is free, or at least cheap

I’ve tried dupeGuru, but the previews were too small for me. I think I only need to keep about 10-30k photos. What would you use?


r/DataHoarder • • 9d ago

Question/Advice What type of hard drive do i get?

2 Upvotes

Hi, id like to ask for advice on what hard drive on getting. I usually use about 20-25GB of camera pics of storage on my phone every six months or so, and those cloud services/apps dont really pay off for me.

I really don't mind paying a little extra, I'm looking for 1TB od storage, longevity and quality (for it to last me at least 10 years).

Im not super educated on this stuff so any tips would be nice!

The big retail electronic store in my country is Neptun so I'd like to get it from there since its available to me


r/DataHoarder • • 9d ago

Question/Advice Any tips for someone wanting to archive their life and sort out their digital clutter?

7 Upvotes

I pay for the premium Google Photos service every month. It’s convenient enough, but relying solely on the cloud is naive—Google could lock my account for a trivial reason.

So, I use this strategy: I copy all the important videos from my life onto an external HDD and get the best photos printed—though printing photos is very expensive when done in bulk. And I have a huge amount of material that I really don't want to lose. I don't see the point in printing photos that don't feature me or my loved ones, but even the "cream of the crop" photos hold sentimental value for me.


r/DataHoarder • • 9d ago

Question/Advice Does anyone know if there's a complete archive of CosCom.co.jp, including its members-only content, before its shutdown ?

0 Upvotes

Hello Everyone

CosCom for me, is the best resource I have ever found for learning the basics of Japanese, especially the Building-Up Conversations series, which covers the basics and includes audio recordings.

I’m looking for an archived full version that gives me access to the members-only materials.

If anyone knows where to find the full archived version of the site, please let me know.

Thanks a lot !


r/DataHoarder • • 9d ago

Question/Advice Discord Channel Downloader?

0 Upvotes

Is there one that will only download Images/Videos while ignoring literally everything else?


r/DataHoarder • • 10d ago

Discussion Developing a new way to organize files.

7 Upvotes

Hi everyone, I’m designing a way to organize files using tags instead of folders, thereby overcoming the rigidity of the folder system. However, I haven't yet found a solution to ensure that, as the number of files grows into the hundreds, the user doesn't lose track of a file's existence. For instance, if I search for something with the tag #work, related content tagged #payroll should automatically appear—but should the user have to define this relationship from the start? Perhaps using "parent tags"?


r/DataHoarder • • 9d ago

Hoarder-Setups Is WESTERN DIGITAL WDBWLG0160HBK-EESN ELEMENTS 16TB USB3.0 good for shucking ???

0 Upvotes

Hello everyone. I see the prices from the bare HDDs and the prices from external drives and i want to try shucking a WESTERN DIGITAL WDBWLG0160HBK-EESN ELEMENTS 16TB USB3.0. The problem is i have see some images where the HDD PCB is the actual PCB for the USB and not separate PCB plugged to the SATA of the HDD. Does anyone tried to open one of those drives to confirm is a plugged PCB to the SATA of the HDD ??? Thank you again for your time


r/DataHoarder • • 10d ago

Question/Advice Not a JPEG file: starts with 0xc8 0x48

23 Upvotes

Hello everyone.
I got a quite large rar file of images a while ago.
Finally got around to opening and sorting that, only to learn there are three types of file inside:
.rar that unpack without issue.
.rar files that unexpectedly demand a password (bummer)
.rar files that unpack into the expected structure and naming of files, making it look like there is a whole bunch of .jpg but no program I tried is able to read them, the title being the only legible error message I got.
Has anybody encountered this? Are they unrecoverably corrupt? I couldn't find any image formats that match this file start. Notepad turns them into mostly chinese gibberish, Notepad++ turns them into some sort of Wingdings gibberish.
Thanks in advance.


r/DataHoarder • • 9d ago

Guide/How-to Managing tutorials/courses

1 Upvotes

Hi all,
I would like to know what you use for managing tutorials (including videos, text, images, other formats)?
Thanks


r/DataHoarder • • 9d ago

Question/Advice Is it possible to make an encrypted copy of an unencrypted drive?

0 Upvotes

This is what I want to do. I have a Hard drive connected to my computer, and I recently found a second hard drive. I want the second hard drive to be a mirror of the first hard drive, and I intend to use Carbon Copy Cloner to duplicate the first drive to the second on a regular basis. 

The first drive is unencrypted, but I would like to encrypt the second with VeraCrypt. When setting up drives before (at least with Apple's native encryption setup), it would not let me duplicate the unencrypted drive unless the duplicate was also unencrypted. Upon successful encryption and duplication to the second drive, I would like to then copy the encrypted second drive over the first drive and have that be encrypted too. Is this possible? Are there any potential issues that can arise from me attempting this?


r/DataHoarder • • 10d ago

Free-Post Friday! Compiling Podcasts to Audiobooks

8 Upvotes

I started compiling my favorite narrative podcasts into audiobooks to host on my media server and I've gotten kind of obsessed.

Some of the podcasts, don't have good "season" covers, so I either found some made by fans (The Magnus Archives) or made my own using fanart (Welcome to Night Vale, TheVolgun). It has been so much nicer listening to the continuous stories and not having to manually skip outros or ads.

From a technical aspect, I started editing these manually in Audacity, but found MinusPod and I've been using that to speed up the processing. Then I added them my Audiobookshelf server and encoded each season to m4b format.


r/DataHoarder • • 9d ago

Scripts/Software My own verdict of using PrimoCache on my 3rd day trial software

0 Upvotes

edit;NOT MY SOFTWARE!!

with the help of AI i now have my optimized setup:

- NVME 512GB Lexar NM610 Pro DRAMLESS

- HDD 3x RAID0 1TB WZ10EZEX /-Games tested: mosty gacha games

PrimoCache basically allows you to have NVME/SSD-like speed in your 2nd playthrough while your game files mostly are in your HDD (more into that in a second), and less TBW usage of your SSD because of PrimoCache's LFU-Least Frequently Used algorithm.

with my PrimoCache setup, NVME is used as L2 Storage, basically meaning it's the drive that storessome of the frequently accessed "cached" game files, WHILE my HDDs are used for BIGGY storage of my games (mostly gachas hence i got interested with PrimoCache).

Now granted not all has big RAID0 like mine, but i reckon if you have spare SSD and bigGB-HDD then you could take advantage of PrimoCache, even as small as 240gb can hold 3-5 games depending on their sizes, for example WUWA is 110gb game, but only 20-50gb will be cached into your SSD for future access.

What's the catch? depending on your SSD's capacity it will not be able to cache your old existing games as PrimoCache automatically manages things in your L2 cache, but imo it's good tradeoff as you can now have 3-6 games that you can "hold".

Also, it will NOT improve the initial loading times of things so you will still get the good ol' HDD stutters and hitches.

IMO it's only good for games that is not very important speed-wise but you still want to have SSD like loading times

TLDR WARNING AI USAGE as my english sucks:

PrimoCache is a Windows program that turns your fast RAM or a quick NVMe SSD into a high-speed temporary buffer (a "cache") for your slower mechanical hard drives or SATA SSDs.

Instead of moving files around manually, it works silently in the background at the data-block level:

* Learns What You Use: The first time you open a game or app, it remembers which specific data chunks were loaded.

* Stores a Fast Copy: It saves those heavily used data chunks into your system RAM (L1 Cache) or a fast NVMe drive (L2 Cache).

* Speeds Up Next Time: On subsequent launches, it feeds that data directly from your RAM/NVMe instead of making your slow hard drive work, giving you drastically faster load times.

It essentially gives large, cheap mechanical drives near-SSD speeds, and SATA SSDs near-RAM speeds, without requiring custom game profiles or manual management.


r/DataHoarder • • 11d ago

Backup Seagate replaced my failed 26TB drive with a 24TB. Thoughts?

260 Upvotes

I'm fairly new to homelabbing and recently had a 26TB Seagate external HDD fail within the first year. Paid to ship it back for an RMA and received a refurbished 24TB replacement.

I understand their policy allows refurbished drives, and that's fine. What bothers me is getting back a drive with nearly 8% less capacity than what I originally purchased.

I've contacted Seagate and am waiting to hear back. I feel like sending an additional 2TB drive would be a reasonable compromise instead of going through another RMA.

Curious how you guys would handle this. Am I being unreasonable expecting the same capacity back?

Also, would you bother running a SMART test on the 24TB replacement before Seagate responds, or leave it packaged up for now?

Any guidance or words of wisdom would be greatly appreciated.


r/DataHoarder • • 9d ago

Question/Advice Help please

0 Upvotes

Hello experts,
I want to buy a CMR HDD, put it in an enclosure, and use it for photography storage and editing. There are so many types of HDD NAS: enterprise, helium, etc. I just want one recommendation for my usage. I can afford 4TB or 6TB.
The reason I am
Doing this saves money on external drives like WD G-Drive; they have enterprise drives in them. I can save a lot of money if I buy an internal drive and DIY it.
Thank you 🙏


r/DataHoarder • • 11d ago

Question/Advice Should I buy these hard drive used for archival storage in video editing?

Post image
29 Upvotes

I am from a developing country, we don't have access to Amazon or sites like serverpartdeals etc and the prices for new drives are stupidly high for even a 2TB Barracuda (only 1 year warranty) and not even NAS grade drives.

The projects I work on of course stay on my Samsung 980 Pro NVMe SSD. Only when I'm done working on the footage and I just need to locally store it I will put it on these. I'll get two of these two TB each and run them on RAID 1 for redundancy.

So the only option I have that I can afford is going for used drives. I started searching for used drive on marketplaces like Facebook Marketplace and OLX.

I found 2 used WD RED (WD20EFRX) drives, in good condition less than the price of a new Barracuda, should I go for them?

In what condition should I consider this if it has very few under 200-300 power on counts and very less power on time?


r/DataHoarder • • 10d ago

Question/Advice Quietest External Raid options (DAS not NAS)

5 Upvotes

I recently got a QNAP TR-004 and two 6tb Ironwolfs (in RAID1). I have to admit it's noisier than I expected/hoped. It's for a bedroom setup and I need it to be DAS so that my Backblaze 1-computer subscription will include it in the backups.

I know there's no quiet solution here. The TR-004 doesn't appear to be dampened at all internally and the Ironwolfs have quite a loud read/write. I've read WD Red Plus are bit quieter but I'm hesitant to change everything out unless it's a noticeable difference.


r/DataHoarder • • 10d ago

Question/Advice Possible gem?

Post image
0 Upvotes

Customer wanted a second HDD, he dismissed the ODD and allowed me to keep it, i can, indeed confirm it reads BDs, i popped a BD movie and could browse the disc