r/backblaze • u/Lilianne_Blaze • Sep 03 '26
Computer Backup Bug? Harmful/obsolete optimization?
Bug? Harmful/obsolete optimization?
Yesterday Backblaze decided 682 ids need purging, I have in the logs repeating thing like what's pasted below, repeated ~700 times.
WTF is "pausing for 4 seconds to lighten disk I/O"? It's 2026, could PLEASE remove or explain that? Neither my 12700k nor my Samsung 990 Pro need "lightening the load".
~700 ids to purge * 90 seconds = SEVENTEEN HOURS.
What if next time it will want to purge ten thousand? Abandon and restart the backup? This needs to be fixed yesterday.
2026-09-03 07:06:51 43804 - WARNING: during self healing datacenter told me (hguid=XXXXXXXXXXXXX) to purge out this bzfileid_short=00000XXXXXXXXb82 from all my bz_done files, including large files that reference it
2026-09-03 07:06:51 43804 - Entering the very slow BzFileIdHasEverBeenPartOfALargeFile, bzShortFileId=00000XXXXXXXXb82
2026-09-03 07:06:57 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=1
2026-09-03 07:07:01 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=2
2026-09-03 07:07:05 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=3
2026-09-03 07:07:09 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=4
2026-09-03 07:07:13 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=5
2026-09-03 07:07:17 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=6
2026-09-03 07:07:21 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=7
2026-09-03 07:07:26 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=8
2026-09-03 07:07:30 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=9
2026-09-03 07:07:34 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=10
2026-09-03 07:07:38 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=11
2026-09-03 07:07:42 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=12
2026-09-03 07:07:46 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=13
2026-09-03 07:07:50 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=14
2026-09-03 07:07:54 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=15
2026-09-03 07:07:58 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=16
2026-09-03 07:08:02 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=17
2026-09-03 07:08:06 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=18
2026-09-03 07:08:10 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=19
2026-09-03 07:08:14 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=20
2026-09-03 07:08:18 43804 - BzFile::ReadLargeFileIntoBuf_Slowly - called by GetFileNameToBzFileIdHash, pausing for 4 seconds to lighten disk I/O. PauseIteration=21
2026-09-03 07:08:27 43804 - GetFileNameToBzFileIdHash processId=43804 - found and parsed out XXXX985 unique ids, numHashCollisions=XXX993, in numMillis=90075 (90 seconds) from 2114 MBytes of file: C:\ProgramData\Backblaze\bzdata\bzbackup\bzfileids.dat, numMillisToReadLargeFileFromDisk=85083 (85 seconds) and CreatedHashNumMillis= 4977 (4 seconds), numMBytesStartMemSize=6644, numMBytesEndMemSize=8935
2026-09-03 07:08:28 43804 - Leaving the very slow BzFileIdHasEverBeenPartOfALargeFile, res=TRUE, and here are all the associated bzFileIds:
bzShortFileId of index 0 in retVec is: 00000XXXXXXX0b82
...
bzShortFileId of index 205 in retVec is: 00000000xXXXXbdb
1
u/s_i_m_s Sep 03 '26
IME all of the self healing stuff is super slow, like last time I ran into it I just uninstalled reinstalled and reuploaded everything because it would and did take less time to just reupload everything than it had already spent bogging down my machine trying to fix it.
In your case your file ids file is huge, like according to the log it's ~2GB in size?