Backblaze B2 returns 404 and slow Upload

[19] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/fd/041563c79c018f2f3e0e2dc7fad4308f77dbd075e0e7c7e83959767fbfff4a' returned status code 404
Uploaded chunk 1419 size 8519136, 3.54MB/s 3 days 17:45:09 0.5%
[0] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/17/513c4027d64a570e80f16746422e8bd183f1c1484394e30e0c4f9110409ee1' returned status code 404
Uploaded chunk 1421 size 1816317, 3.54MB/s 3 days 17:46:34 0.5%
[1] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/b2/1d7922a9ece9f4da15d11883cd3957f3f9798831dfdbd394188db3acebfd6a' returned status code 404
Uploaded chunk 1416 size 1257117, 3.54MB/s 3 days 17:45:37 0.5%
[9] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/4c/3d3b1108e7b1a3dce29d44068a098396f12dd92a07cc1454eec669bb3d5039' returned status code 404
Uploaded chunk 1422 size 2580176, 3.54MB/s 3 days 17:49:16 0.5%
[15] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/91/b50093f79f27216085bc97ed8bb3bbf643dce0520c38dbf38538bc38d1e507' returned status code 404
Uploaded chunk 1414 size 1928028, 3.54MB/s 3 days 17:53:25 0.5%
[11] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/8f/4cd1f3371cefce551ebb6f4e02363944a8b4ea7997dbf05aef9572cbdd8a94' returned status code 404
Uploaded chunk 1407 size 7747171, 3.54MB/s 3 days 17:47:31 0.5%
[7] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/eb/962e4ef7e914dda805a1af262cd09a40c04f0e2c365e83e45fc4e13219cde3' returned status code 404
Uploaded chunk 1392 size 4889417, 3.54MB/s 3 days 17:46:36 0.5%
[18] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/33/09bff09dfa81482242f2b532d482ee7ee6dbe63681c29a29a23869baaeca7f' returned status code 404
Uploaded chunk 1426 size 2656899, 3.54MB/s 3 days 17:47:23 0.5%
[9] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/ce/23a18fac4f49a5d5630e1a65e50f7e05c21263a502eb280498cc426cd1e5fb' returned status code 404
Uploaded chunk 1428 size 3535120, 3.54MB/s 3 days 17:47:30 0.5%
[11] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/6c/8d51c8e4abe442d91b37fe1280ce9aa3cdcac5d1b8ba5e18e97812c66f3e63' returned status code 404
Uploaded chunk 1374 size 9637241, 3.54MB/s 3 days 17:51:23 0.5%
[3] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/56/968740f4dc48d50c12c6c94e7635ea7353b34b0dbae28999377770073414f8' returned status code 404
Uploaded chunk 1413 size 5763695, 3.53MB/s 3 days 17:55:24 0.5%
[14] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/fe/fc79abb582edf90d4c4a8f17c590000d68e02e96533852341eea678344491f' returned status code 404
Uploaded chunk 1432 size 5791531, 3.53MB/s 3 days 17:53:48 0.5%
[11] URL request 'HEAD https://f002.backblazeb2.com/file/myhiddenbucketid/chunks/95/607351b338e8a4f3281d030aaf83b630e5d7bb220b30bd93d1c4bbeb5441db' returned status code 404

backup command

duplicacy -v backup -storage backblazebackup -threads 20 -stats

Benchmark result

duplicacy benchmark -upload-threads 20 -storage backblazebackup
    Storage set to b2://xxxx
    download URL is: https://f002.backblazeb2.com
    Generating 256.00M byte random data in memory
    Writing random data to local disk
    Wrote 256.00M bytes in 3.43s: 74.68M/s
    Reading the random data from local disk
    Read 256.00M bytes in 2.40s: 106.79M/s
    Split 256.00M bytes into 52 chunks without compression/encryption in 0.99s: 259.14M/s
    Split 256.00M bytes into 52 chunks with compression but without encryption in 1.53s: 166.95M/s
    Split 256.00M bytes into 52 chunks with compression and encryption in 1.58s: 161.58M/s
    Generating 64 chunks
    Uploaded 256.00M bytes in 62.75s: 4.08M/s
    Downloaded 256.00M bytes in 55.18s: 4.64M/s
    Deleted 64 temporary files from the storage

I have the impression that the Error 404 is slowing down the process.

20 threads may be too many. Try a smaller number to see if that increases the upload speed.

The 404 messages are normal – before uploading each chunk Duplicacy will first check if the chunk already exists in the storage. A 404 code means the chunk doesn’t exist.

1 Like