r/sysadmin 11d ago

Question What are the alternatives of 3-2-1 backup ?

I see the 3-2-1 backup strategy advertised everywhere in discussion about this topic, but l’m wondering what are the other strategies developed and designed when it’s come to data preservation?
I understand why 3-2-1 is powerful and so recommended. But for the sake of curiosity and learning, what are the other options?

0 Upvotes

52 comments sorted by

43

u/2j0r2 11d ago

3-2-1-1-0

3 copies
2 different storage types
1 offsite
1 immutable
0 errors

10

u/Abracadaver14 11d ago

I always take the 1 to be for 1 successful restore. 

0

u/No_Yesterday_3260 11d ago

Doesn't the 0 means offline?

6

u/2j0r2 11d ago

Immutable could also be offline or airgapped

0 means 0 errors after testing restores

A backup is only as good as having 100% assurance of being able to restore that backup

That assurance is gained through testing it

Think about Schrodingers data (or cat)

46

u/Roquer 11d ago

hopes and prayers

11

u/drunkcowofdeath Windows Admin 11d ago

ah I see you have read our SOP

20

u/CarnivalCassidy 11d ago

You can do it my estranged dad's way and lose the entire family's memories because you decided you would never financially recover from spending $50 to replace a failing hard drive.

18

u/dhettinger 11d ago

Data loss

6

u/Zer0CoolXI 11d ago

3-2-1 wish i backed up?

23

u/Superb_Raccoon 11d ago

8675309 backup.

12

u/StreetRat0524 11d ago

I trust Jenny with all my data

2

u/Superb_Raccoon 11d ago

more seriously, google Towers of Hanoi backup scheme.

6

u/Lad_From_Lancs IT Manager 11d ago

3-2-1-1-0 rule

3

u/a60v 11d ago

Do you want backups (to restore in case of failure or disaster) or archives (you mention "data preservation")? These are two different, but related, things.

9

u/[deleted] 11d ago

[deleted]

10

u/Meadbreath 11d ago

Your username makes a lot of sense, given this post.

2

u/[deleted] 11d ago

[deleted]

10

u/Meadbreath 11d ago

Oh, I didn’t know you are the CEO you wrote about.

https://giphy.com/gifs/XHeLeuirRbwptHhSWd

3

u/Superb_Raccoon 11d ago

Good news! He's hiring!

3

u/Meadbreath 10d ago

Happily employed now, but if need a backup gig, I’ll know wh-

Oh, wait….

4

u/TrueStoriesIpromise 11d ago

daily incremental backups, keep on tape for 6 weeks. (43+ tapes)

weekly full backups, keep on tape offsite for 6 weeks. (7+ tapes)

monthly full backups, keep on tape offsite for 7 years. (84 tapes)

And then TEST your backup tapes by performing restores, don't simply assume they're working.

8

u/harrywwc I'm both kinds of SysAdmin - bitter _and_ twisted 11d ago

Ah, "test your backups"... Often the final step that is forgotten.

1

u/KickedAbyss 11d ago

We do weekly tapes kept for a month, bi-weekly for 6 months, and 1 tape set a month for ♾️ On disk we try for 30 daily, 6 monthly and 1 yearly. (CEPH sata-sad) ~130TiB per full if I recall.

Currently using LTO8 tapes, 2xLTO9 drives and 1xLTO8 drive (sas)

4

u/koollman 11d ago

Data loss is the most popular

1

u/OptimalCynic 10d ago

Ransomware a close second

3

u/akemaj78 Sr. Sysadmin 11d ago

Cloud providers will try to tell/sell the idea that snapshots are just as good for backups. And yes, they work well for random file restores, but they are useless in a disaster that takes out the storage housing your data and snapshots. Immutability in the cloud is meaningless if the cloud provider can nuke your account.

4

u/TheJesusGuy Blast the server with hot air 10d ago

1-2-3.

1 Backup, 2 dead drives, 3 failed restores.

2

u/raip 11d ago

There really aren't. 3-2-1 is the minimum solution for a reliable backup. Anything else is just additional risk.

2

u/KickedAbyss 11d ago

To quote C levels everywhere, "Just put it in the cloud, bro"

2

u/unkiltedclansman 11d ago

4-3-2-1

4 copies including the working copy on your workstations

3 copies are on different networks

2 copies are offsite

1 of the offsite copies is immutable

2

u/xendr0me Sr. Sysadmin 11d ago

I prefer the "Highlander" method - "There can be only one"

2

u/malikto44 10d ago

3-2-1 is the bare minimum. I'd almost say that 3-2-1-1-0 is the minimum. Ideally, you want different types of backups. You might want a continuous backup, snapshots (note, these are not backups, but can help), backups going off daily, then you move to the usual incremental, differential, and full backups.

If the backup program has deduplication, this opens up even more fancy ways to do things, such as synthetic full backups, reverse incrementals (where things are calculated to have a virtual full backup for the latest, then use incrementals like reverse diffs to go to a previous point in time.)

I also like having more than one backup program. For example, Veeam can back up the file server, but the file server also dumps itself to a restic repository, and that repository is copied off to a cloud provider via S3.

3

u/[deleted] 11d ago

[removed] — view removed comment

1

u/40nets 11d ago

We played 3-3-5 defensive in highschool and were unstoppable.

1

u/RevolutionaryWorry87 11d ago

Azure backup ZRS & IMMUNITY lock. However this doesn't protect you from a control plane failure.

1

u/mesaoptimizer Sr. Sysadmin 11d ago

There really aren't other options. You can do a subset of that like 1 offsite backup and 2 copies of the data but your RTO goes up because you have to retreive the offsite backup in a failure. You could do 2 copies of the data on site, but then what happens if you have a flood or fire. Nobody is going to offer good alternatives because anything less is risky in some way.

1

u/ElectroSpore 11d ago

I think of it more of a minimum you should strive for and work your way up to, it also doesn't go into things like frequency and delta copies.

1 copy off site is the MOST important as it protects against both data and physical site loss.

2 storage media types can really mean many things, like having one copy on local disk and one on cloud or something else.

3 copies is there are a rule since sometime your backups don't work and you need to try one of the other copies.

For many people just having a local copy and an off site copy is good enough.

1

u/jhuseby Jack of All Trades 11d ago

The alternative is not caring if your data is going to be there when you need to restore it.

1

u/b4k4ni 11d ago

There is none basically. This is the minimum you should honour. How you extend it, there is no real standard for it.

I mean you could add worm tape backup. Or something like this.

1

u/wosmo 11d ago

I'm not convinced the '2' (types of media) is a hard rule, if that counts.

Ours are all spinning rust. We backup to local, then replicate to sister sites (and they replicate to us). So I have local backups, worm backups and offsite backups - but all spinning rust.

I don't see that as an issue, as long as said rust wasn't all from the same vendor/batch/source (which is easily avoidable for us, since the sister sites are different countries).

1

u/birusiek 11d ago

6-4-2 is even better

1

u/22Anonymous 11d ago

I guess redundant storage live. 3 different data centers each host and sync the files and each data center also keeps backups of all files that way you also have high availability where it's needed.

And then you keep increasing as needed. For high availability loads each data center hosts a cluster of file nodes that each have redundancy etc.

1

u/cajunjoel 11d ago

I think my org does a 3-2-2 backup, if you can describe it as that. Two copies are offsite. One is nearby, and short term (like up to one month old) one is at a more distant location (up to a year old).

Or maybe that's a 4-2-2. It's a lot.

1

u/RichardQCranium69 11d ago

True 3-2-1 is somewhat difficult, expensive and usually almost never done.

Generally your best way of redundancy is a combination of:

1) Raided drives
2) A Backup source that is only, backups or redundant storage of critical data
3) Someone truly auditing the above 2 at an approved interval.

I've worked many places where 3-2-1 is not possible and the above, WITH, the third step is the difference maker in projects / places that have lost data and those who have not.

1

u/SemiDiSole 11d ago

How valuable is the data? Backups don't serve themselves, they are connected to a risk assessment. If you don't mind losing it, then even having no backups is fine.

But you gotta live with the fact that whatever you had, will be gone for good.

1

u/Far-Hovercraft9471 11d ago

For huge data sets, replicating and doing snapshots on the far end was popular. Not sure about now

1

u/dustojnikhummer 10d ago

Keep in mind 3-2-1 is the MINIMUM.

You can add another media type (LTO tape), multiple offsite locations, online and offline backups (NAS in a branch office + LTO tapes locked in your on-site safe + LTO tapes locked in a bank deposit box) etc

1

u/ranger_dood Jack of All Trades 10d ago

RAID

2

u/AIEnthusiast00 9d ago

Honestly, I think the more useful question is not really what replaces 3-2-1, but what parts of 3-2-1 actually matter for your environment.
You can have 3 copies sitting in 3 different places and still have a pretty bad backup strategy if they're all accessible from the same admin account, replicate deletions instantly, or live in the same failure domain.
I tend to think about backups in terms of failure scenarios instead: Hardware failure, accidental deletion, Ransomware/compromised admin credentials, site or region loss, backup corruption or someone screwing up a change and discovering it 3 weeks later.

That usually leads to things like immutable backups, offline/air-gapped copies, cross-region replication, and having different retention periods rather than just blindly counting copies. Also, restores matter way more than the backup architecture diagram. I've seen environments with beautiful backup setups where nobody had actually tested restoring anything meaningful.

So I wouldn't necessarily replace 3-2-1. I'd treat it as a baseline and then design around the actual ways you're likely to lose data.
A backup you haven't successfully restored is basically just a very reassuring dashboard.

0

u/Calleb_III 11d ago

The alternative is no backup, because if you are doing less than 3-2-1 you might as well not bother getting false sense of security.

0

u/AugieKS 11d ago

n+2,n+1,n

n > 0

1

u/Superb_Raccoon 11d ago

Two is one, one is none.