Operation timed out Failed to upload the chunk

Bug
#1

Hi!
I’m getting this operations timeout since I upgraded to Big Sur. I don’t know if it’s related or not. The last time I got this error I did a check + prune and it finished uploading.
This backup is around 230gb of data, but I don’t know where it is right now. I have started it multiple times after getting this error and it keeps going for an hour or so before getting the error again.

What should I do?

Running backup command from /Users/carlosferrarifotografia/.duplicacy-web/repositories/localhost/0 to back up /Volumes/CF1 DADOS

Options: [-log backup -storage CFF_BACKUP-NAS -threads 4 -stats]

2020-11-24 14:27:09.921 INFO REPOSITORY_SET Repository set to /Volumes/CF1 DADOS

2020-11-24 14:27:09.921 INFO STORAGE_SET Storage set to /Volumes/CFF BACKUP

2020-11-24 14:27:12.005 INFO BACKUP_START Last backup at revision 42 found

2020-11-24 14:27:12.005 INFO BACKUP_INDEXING Indexing /Volumes/CF1 DADOS

2020-11-24 14:27:12.005 INFO SNAPSHOT_FILTER Parsing filter file /Users/carlosferrarifotografia/.duplicacy-web/repositories/localhost/0/.duplicacy/filters

2020-11-24 14:27:12.005 INFO SNAPSHOT_FILTER Loaded 5 include/exclude pattern(s)

2020-11-24 14:27:15.533 INFO BACKUP_THREADS Use 4 uploading threads

2020-11-24 15:37:19.631 ERROR UPLOAD_CHUNK Failed to upload the chunk 622ed16efd5ac1d0abf96405c121ff42c4b9a6f4d4b20216f41692df9c7e539a: sync /Volumes/CFF BACKUP/chunks/62/2ed16efd5ac1d0abf96405c121ff42c4b9a6f4d4b20216f41692df9c7e539a.ewnqhkzy.tmp: operation timed out

2020-11-24 15:37:19.631 ERROR UPLOAD_CHUNK Failed to upload the chunk e6a5130287700e2bab6ea0aaf7a4cc2b6a9f5a51e0527983a1f0970af5e6f41e: sync /Volumes/CFF BACKUP/chunks/e6/a5130287700e2bab6ea0aaf7a4cc2b6a9f5a51e0527983a1f0970af5e6f41e.zkomqvmi.tmp: operation timed out

Failed to upload the chunk 622ed16efd5ac1d0abf96405c121ff42c4b9a6f4d4b20216f41692df9c7e539a: sync /Volumes/CFF BACKUP/chunks/62/2ed16efd5ac1d0abf96405c121ff42c4b9a6f4d4b20216f41692df9c7e539a.ewnqhkzy.tmp: operation timed out Failed to upload the chunk e6a5130287700e2bab6ea0aaf7a4cc2b6a9f5a51e0527983a1f0970af5e6f41e: sync /Volumes/CFF BACKUP/chunks/e6/a5130287700e2bab6ea0aaf7a4cc2b6a9f5a51e0527983a1f0970af5e6f41e.zkomqvmi.tmp: operation timed out
#2

Can this caused by a temporary network error (assuming /Volumes/CFF BACKUP is a network mounted drive)?

#3

Sorry for the late reply.

It seems related to my NAS and Big Sur. I couldn’t figure this out yet. I might test different connection types, currently I’m connecting with SMB3. Gonna enable AFP and for SMB2 to see if it solves.

Gonna search for SMB3 problems with Big Sur as well.

For now, if it fails, I run it again and again until it finishes…

#4

Hi again!

It’s been a while since I’v starting getting this errors with mounted network drivers. I have a Synology DS216J which I backup to.

After Big Sur It started to fail when I backup. It’s often around 80-120gb of data and I can only finish it after restarting the backup job for 3-4x until it finally finishes…

I have updated everything from Synology, disabled SMB3, forced SMB2, multiple configurations on this and it will always fail at some point.

How could I investigate it further?

Running backup command from /Users/carlosferrarifotografia/.duplicacy-web/repositories/localhost/0 to back up /Volumes/CF1 DADOS
Options: [-log backup -storage CFF_BACKUP-NAS -threads 48 -stats]
2021-01-19 10:52:18.935 INFO REPOSITORY_SET Repository set to /Volumes/CF1 DADOS
2021-01-19 10:52:18.938 INFO STORAGE_SET Storage set to /Volumes/CFF BACKUP
2021-01-19 10:52:21.937 INFO BACKUP_START Last backup at revision 53 found
2021-01-19 10:52:21.937 INFO BACKUP_INDEXING Indexing /Volumes/CF1 DADOS
2021-01-19 10:52:21.938 INFO SNAPSHOT_FILTER Parsing filter file /Users/carlosferrarifotografia/.duplicacy-web/repositories/localhost/0/.duplicacy/filters
2021-01-19 10:52:21.938 INFO SNAPSHOT_FILTER Loaded 6 include/exclude pattern(s)
2021-01-19 10:52:24.885 INFO BACKUP_THREADS Use 48 uploading threads
2021-01-19 11:29:12.261 ERROR UPLOAD_CHUNK Failed to upload the chunk 3e645d8c4da4b1f80d15db98f4a65667f62988398253953e816cef47ad3c7a37: close /Volumes/CFF BACKUP/chunks/3e/645d8c4da4b1f80d15db98f4a65667f62988398253953e816cef47ad3c7a37.qrsystds.tmp: operation timed out
Failed to upload the chunk 3e645d8c4da4b1f80d15db98f4a65667f62988398253953e816cef47ad3c7a37: close /Volumes/CFF BACKUP/chunks/3e/645d8c4da4b1f80d15db98f4a65667f62988398253953e816cef47ad3c7a37.qrsystds.tmp: operation timed out
#5

For what it’s worth, I got similar errors recently when manually running backups of one of my VMs (fixed chunk size) to my Windows Server over network share (CIFS) - whereas my normal backups, which don’t take as long, have always run fine.

Took three retries to finish the backup. I’m wondering if network share backups should have a better retry mechanism. I’ve been thinking of switching to sftp anyway, which might be more robust…

#6

So it looks like this may be Big Sur related :thinking: 11.2 fixed a number of issues with regards to networking, but this definitely after across the upgrade.

I am also seeing this behaviour for an SMB3 mounted storage on web-ui on a Mac running 11.2.1.

It does not seem to be network related, as I tried an hours long rsync in parallel with no issues.

@Droolio brings up an interesting though around retry mechanism, but I am thinking a delayed timeout might be a resolution as well.

1 Like
#7

I’v fixed the issue for now running in AFP. It’s way slower, but it finished without timeouts…