OneDrive check fails after prune

[marcnijman]

check_part2

2025-04-24 19:51:14.807 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/e2:/children?top=1000&select=name,size,folder

2025-04-24 19:51:15.039 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/e4:/children?top=1000&select=name,size,folder

2025-04-24 19:51:15.274 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/e7:/children?top=1000&select=name,size,folder

2025-04-24 19:51:15.558 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/e8:/children?top=1000&select=name,size,folder

2025-04-24 19:51:15.791 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/eb:/children?top=1000&select=name,size,folder

2025-04-24 19:51:16.074 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/ec:/children?top=1000&select=name,size,folder

2025-04-24 19:51:16.346 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/ee:/children?top=1000&select=name,size,folder

2025-04-24 19:51:16.586 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/ef:/children?top=1000&select=name,size,folder

2025-04-24 19:51:16.898 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/f0:/children?top=1000&select=name,size,folder

2025-04-24 19:51:17.129 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/f1:/children?top=1000&select=name,size,folder

2025-04-24 19:51:17.375 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/f2:/children?top=1000&select=name,size,folder

2025-04-24 19:51:17.713 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/f5:/children?top=1000&select=name,size,folder

2025-04-24 19:51:17.923 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/f6:/children?top=1000&select=name,size,folder

2025-04-24 19:51:18.177 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/f7:/children?top=1000&select=name,size,folder

2025-04-24 19:51:18.436 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/f8:/children?top=1000&select=name,size,folder

2025-04-24 19:51:18.702 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/f9:/children?top=1000&select=name,size,folder

2025-04-24 19:51:18.962 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/fa:/children?top=1000&select=name,size,folder

2025-04-24 19:51:19.201 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/fb:/children?top=1000&select=name,size,folder

2025-04-24 19:51:19.426 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/fc:/children?top=1000&select=name,size,folder

2025-04-24 19:51:19.777 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/fd:/children?top=1000&select=name,size,folder

2025-04-24 19:51:19.961 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/fe:/children?top=1000&select=name,size,folder

2025-04-24 19:51:20.173 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/04:/children?top=1000&select=name,size,folder

2025-04-24 19:51:20.411 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/1a:/children?top=1000&select=name,size,folder

2025-04-24 19:51:20.661 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/21:/children?top=1000&select=name,size,folder

2025-04-24 19:51:20.980 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/34:/children?top=1000&select=name,size,folder

2025-04-24 19:51:21.269 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/38:/children?top=1000&select=name,size,folder

2025-04-24 19:51:21.537 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/56:/children?top=1000&select=name,size,folder

2025-04-24 19:51:21.809 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/5b:/children?top=1000&select=name,size,folder

2025-04-24 19:51:22.061 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/5e:/children?top=1000&select=name,size,folder

2025-04-24 19:51:22.360 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/63:/children?top=1000&select=name,size,folder

2025-04-24 19:51:22.692 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/64:/children?top=1000&select=name,size,folder

2025-04-24 19:51:22.935 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/69:/children?top=1000&select=name,size,folder

2025-04-24 19:51:23.144 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/71:/children?top=1000&select=name,size,folder

2025-04-24 19:51:23.391 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/78:/children?top=1000&select=name,size,folder

2025-04-24 19:51:23.584 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/7e:/children?top=1000&select=name,size,folder

2025-04-24 19:51:23.993 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/7f:/children?top=1000&select=name,size,folder

2025-04-24 19:51:24.235 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/94:/children?top=1000&select=name,size,folder

2025-04-24 19:51:24.573 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/95:/children?top=1000&select=name,size,folder

2025-04-24 19:51:24.855 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/9c:/children?top=1000&select=name,size,folder

2025-04-24 19:51:25.147 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/a3:/children?top=1000&select=name,size,folder

2025-04-24 19:51:26.711 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/a7:/children?top=1000&select=name,size,folder

2025-04-24 19:51:26.974 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/a8:/children?top=1000&select=name,size,folder

2025-04-24 19:51:27.211 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/a9:/children?top=1000&select=name,size,folder

2025-04-24 19:51:27.424 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/aa:/children?top=1000&select=name,size,folder

2025-04-24 19:51:27.698 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/b1:/children?top=1000&select=name,size,folder

2025-04-24 19:51:27.941 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/b5:/children?top=1000&select=name,size,folder

2025-04-24 19:51:28.306 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/d8:/children?top=1000&select=name,size,folder

2025-04-24 19:51:28.555 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/dd:/children?top=1000&select=name,size,folder

2025-04-24 19:51:28.813 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/fa:/children?top=1000&select=name,size,folder

2025-04-24 19:51:29.016 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/fd:/children?top=1000&select=name,size,folder

2025-04-24 19:51:29.350 TRACE SNAPSHOT_LIST_IDS Listing all snapshot ids

2025-04-24 19:51:29.350 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children?top=1000&select=name,size,folder

2025-04-24 19:51:29.635 TRACE SNAPSHOT_LIST_REVISIONS Listing revisions for snapshot UnraidAppdata

2025-04-24 19:51:29.635 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:29.868 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:30.126 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:30.127 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata:/children?top=1000&select=name,size,folder

2025-04-24 19:51:30.435 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:30.635 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:30.828 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:30.829 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/3?select=id,name,size,folder

2025-04-24 19:51:31.130 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/snapshots/UnraidAppdata/3:/content

2025-04-24 19:51:31.575 DEBUG DOWNLOAD_FILE Downloaded file snapshots/UnraidAppdata/3

2025-04-24 19:51:31.575 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:31.798 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:31.989 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:31.989 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/4?select=id,name,size,folder

2025-04-24 19:51:32.368 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/snapshots/UnraidAppdata/4:/content

2025-04-24 19:51:32.705 DEBUG DOWNLOAD_FILE Downloaded file snapshots/UnraidAppdata/4

2025-04-24 19:51:32.705 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:32.964 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:33.158 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:33.159 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/5?select=id,name,size,folder

2025-04-24 19:51:33.430 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/snapshots/UnraidAppdata/5:/content

2025-04-24 19:51:33.850 DEBUG DOWNLOAD_FILE Downloaded file snapshots/UnraidAppdata/5

2025-04-24 19:51:33.850 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:34.169 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:34.351 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:34.351 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/6?select=id,name,size,folder

2025-04-24 19:51:34.569 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/snapshots/UnraidAppdata/6:/content

2025-04-24 19:51:34.965 DEBUG DOWNLOAD_FILE Downloaded file snapshots/UnraidAppdata/6

2025-04-24 19:51:34.965 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:35.242 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:35.418 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:35.419 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/7?select=id,name,size,folder

2025-04-24 19:51:35.632 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/7 from the snapshot cache

2025-04-24 19:51:35.632 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:35.856 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:36.064 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:36.065 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/8?select=id,name,size,folder

2025-04-24 19:51:36.308 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/8 from the snapshot cache

2025-04-24 19:51:36.308 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:36.559 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:36.720 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:36.720 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/9?select=id,name,size,folder

2025-04-24 19:51:36.988 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/9 from the snapshot cache

2025-04-24 19:51:36.988 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:37.177 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:37.343 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:37.343 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/10?select=id,name,size,folder

2025-04-24 19:51:37.570 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/10 from the snapshot cache

2025-04-24 19:51:37.570 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:37.853 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:38.113 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:38.114 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/11?select=id,name,size,folder

2025-04-24 19:51:38.346 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/11 from the snapshot cache

2025-04-24 19:51:38.346 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:38.550 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:38.736 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:38.737 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/12?select=id,name,size,folder

2025-04-24 19:51:38.979 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/12 from the snapshot cache

2025-04-24 19:51:38.979 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-24 19:51:39.162 DEBUG ONEDRIVE_CALL POST https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-24 19:51:39.404 TRACE ONEDRIVE_MKDIR The directory ‘Duplicacy/snapshots/UnraidAppdata’ already exists

2025-04-24 19:51:39.405 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/13?select=id,name,size,folder

2025-04-24 19:51:39.659 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/13 from the snapshot cache

2025-04-24 19:51:39.659 INFO SNAPSHOT_CHECK 1 snapshots and 11 revisions

2025-04-24 19:51:39.659 INFO SNAPSHOT_CHECK Total chunk size is 1,052M in 236 chunks

2025-04-24 19:51:39.706 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/fd/552dcbbfb7e19b69cebd2c12f0ac2d0ec2f5eaf81cc622a256ddbaa1b67bcf?select=id,name,size,folder

2025-04-24 19:51:39.887 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/fd/552dcbbfb7e19b69cebd2c12f0ac2d0ec2f5eaf81cc622a256ddbaa1b67bcf?select=id,name,size,folder

2025-04-24 19:51:40.099 WARN DOWNLOAD_FOSSIL Chunk fd552dcbbfb7e19b69cebd2c12f0ac2d0ec2f5eaf81cc622a256ddbaa1b67bcf is a fossil

2025-04-24 19:51:40.099 DEBUG ONEDRIVE_CALL GET https_://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/chunks/fd/552dcbbfb7e19b69cebd2c12f0ac2d0ec2f5eaf81cc622a256ddbaa1b67bcf.fsl:/content

2025-04-24 19:51:40.314 WARN DOWNLOAD_CHUNK Failed to download the chunk fd552dcbbfb7e19b69cebd2c12f0ac2d0ec2f5eaf81cc622a256ddbaa1b67bcf: 404 The resource could not be found.

2025-04-24 19:51:40.314 ERROR SNAPSHOT_CHUNK Failed to load chunks for snapshot UnraidAppdata at revision 3: unexpected end of JSON input

Failed to load chunks for snapshot UnraidAppdata at revision 3: unexpected end of JSON input

[saspus]

@marcnijman

ok, removed two snapshots (files) from OneDrive and ran prune succesfully, with some 404’s & check (failed).

The point was to underhand why does not prune delete them. If you deleted them manually that sort of defeats the point of the experiment.

But I’ll review the logs in a bit in case there is something else

Actually, they are probably in the recycle bin on OneDrive. Please restore 1 and 2 and run prune with logging . The goal is to understands why do files remain after prunes is supposedly deleting them

Check failing is expected, there are probably more snapshots like these

[marcnijman]

I thought deleting snapshots was the way to get the backup running again and watch it with debug logging from there, sorry - I misunderstood.

I restored the files from the recyle bin and ran the prune with debug logging, see below.

Prune

Running prune command from /cache/localhost/all

Options: [-log -d prune -storage OneDrive -keep 0:7 -a]

2025-04-25 11:37:03.269 INFO STORAGE_SET Storage set to one://Duplicacy

2025-04-25 11:37:03.269 DEBUG PASSWORD_ENV_VAR Reading the environment variable DUPLICACY_ONEDRIVE_ONE_TOKEN

2025-04-25 11:37:03.269 DEBUG PASSWORD_ENV_VAR Reading the environment variable DUPLICACY_ONEDRIVE_ONE_CLIENT_ID

2025-04-25 11:37:03.269 DEBUG ONEDRIVE_CALL POST ://duplicacy.com/one_refresh

2025-04-25 11:37:03.650 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy?select=id,name,size,folder

2025-04-25 11:37:04.522 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks?select=id,name,size,folder

2025-04-25 11:37:04.824 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils?select=id,name,size,folder

2025-04-25 11:37:05.126 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:05.369 DEBUG PASSWORD_ENV_VAR Reading the environment variable DUPLICACY_ONEDRIVE_PASSWORD

2025-04-25 11:37:05.369 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/config?select=id,name,size,folder

2025-04-25 11:37:05.669 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/config:/content

2025-04-25 11:37:06.975 TRACE CONFIG_ITERATIONS Using 16384 iterations for key derivation

2025-04-25 11:37:06.990 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/nesting?select=id,name,size,folder

2025-04-25 11:37:07.300 DEBUG STORAGE_NESTING Chunk read levels: [1], write level: 1

2025-04-25 11:37:07.302 INFO CONFIG_INFO Compression level: 201

2025-04-25 11:37:07.302 INFO CONFIG_INFO Average chunk size: 4194304

2025-04-25 11:37:07.302 INFO CONFIG_INFO Maximum chunk size: 16777216

2025-04-25 11:37:07.302 INFO CONFIG_INFO Minimum chunk size: 1048576

2025-04-25 11:37:07.302 INFO CONFIG_INFO Chunk seed: 44554e71bf53fd36060306b42367b1ff4c65f31cc4dbb11486cfb9ca17350b18

2025-04-25 11:37:07.302 TRACE CONFIG_INFO Hash key: f44c719f421634e24c41dc3b4c34bfe19405ed4d34afe566b2442f2d12095e12

2025-04-25 11:37:07.302 TRACE CONFIG_INFO ID key: fb9b41f9ce9f17f76c3fd1afc74bcb391eb5ada539f57c4c41b26522ee851377

2025-04-25 11:37:07.302 TRACE CONFIG_INFO File chunks are encrypted

2025-04-25 11:37:07.302 TRACE CONFIG_INFO Metadata chunks are encrypted

2025-04-25 11:37:07.303 DEBUG DELETE_PARAMETERS id: , revisions: [], tags: [], retentions: [0:7], exhaustive: false, exclusive: false, dryrun: false, deleteOnly: false, collectOnly: false

2025-04-25 11:37:07.304 INFO RETENTION_POLICY Keep no snapshots older than 7 days

2025-04-25 11:37:07.304 TRACE SNAPSHOT_LIST_IDS Listing all snapshot ids

2025-04-25 11:37:07.304 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children?top=1000&select=name,size,folder

2025-04-25 11:37:07.691 TRACE SNAPSHOT_LIST_REVISIONS Listing revisions for snapshot UnraidAppdata

2025-04-25 11:37:07.691 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:08.001 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:08.197 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:08.197 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata:/children?top=1000&select=name,size,folder

2025-04-25 11:37:08.427 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:08.672 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:08.913 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:08.913 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/1?select=id,name,size,folder

2025-04-25 11:37:09.208 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/snapshots/UnraidAppdata/1:/content

2025-04-25 11:37:09.591 DEBUG DOWNLOAD_FILE Downloaded file snapshots/UnraidAppdata/1

2025-04-25 11:37:09.591 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:09.813 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:10.042 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:10.042 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/2?select=id,name,size,folder

2025-04-25 11:37:10.237 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/snapshots/UnraidAppdata/2:/content

2025-04-25 11:37:10.633 DEBUG DOWNLOAD_FILE Downloaded file snapshots/UnraidAppdata/2

2025-04-25 11:37:10.633 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:10.930 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:11.096 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:11.097 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/3?select=id,name,size,folder

2025-04-25 11:37:11.352 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/3 from the snapshot cache

2025-04-25 11:37:11.352 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:11.696 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:11.893 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:11.893 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/4?select=id,name,size,folder

2025-04-25 11:37:12.112 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/4 from the snapshot cache

2025-04-25 11:37:12.112 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:12.378 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:12.624 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:12.625 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/5?select=id,name,size,folder

2025-04-25 11:37:12.851 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/5 from the snapshot cache

2025-04-25 11:37:12.851 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:13.101 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:13.263 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:13.263 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/6?select=id,name,size,folder

2025-04-25 11:37:13.483 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/6 from the snapshot cache

2025-04-25 11:37:13.483 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:13.788 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:13.965 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:13.965 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/7?select=id,name,size,folder

2025-04-25 11:37:14.262 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/7 from the snapshot cache

2025-04-25 11:37:14.262 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:14.475 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:14.694 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:14.694 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/8?select=id,name,size,folder

2025-04-25 11:37:14.976 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/8 from the snapshot cache

2025-04-25 11:37:14.976 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:15.170 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:15.338 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:15.338 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/9?select=id,name,size,folder

2025-04-25 11:37:15.636 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/9 from the snapshot cache

2025-04-25 11:37:15.636 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:15.895 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:16.089 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:16.090 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/10?select=id,name,size,folder

2025-04-25 11:37:16.307 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/10 from the snapshot cache

2025-04-25 11:37:16.307 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:16.587 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:16.815 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:16.815 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/11?select=id,name,size,folder

2025-04-25 11:37:17.046 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/11 from the snapshot cache

2025-04-25 11:37:17.046 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:17.262 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:17.467 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:17.467 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/12?select=id,name,size,folder

2025-04-25 11:37:17.787 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/12 from the snapshot cache

2025-04-25 11:37:17.787 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:17.992 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:18.238 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:18.239 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/13?select=id,name,size,folder

2025-04-25 11:37:18.415 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/13 from the snapshot cache

2025-04-25 11:37:18.415 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots?select=id,name,size,folder

2025-04-25 11:37:18.645 DEBUG ONEDRIVE_CALL POST ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots:/children

2025-04-25 11:37:18.813 TRACE ONEDRIVE_MKDIR The directory 'Duplicacy/snapshots/UnraidAppdata' already exists

2025-04-25 11:37:18.813 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/snapshots/UnraidAppdata/14?select=id,name,size,folder

2025-04-25 11:37:19.019 DEBUG DOWNLOAD_FILE_CACHE Loaded file snapshots/UnraidAppdata/14 from the snapshot cache

2025-04-25 11:37:19.019 DEBUG SNAPSHOT_DELETE Snapshot UnraidAppdata at revision 1 to be deleted - older than 7 days

2025-04-25 11:37:19.019 DEBUG SNAPSHOT_DELETE Snapshot UnraidAppdata at revision 2 to be deleted - older than 7 days

2025-04-25 11:37:19.019 DEBUG SNAPSHOT_DELETE Snapshot UnraidAppdata at revision 3 to be deleted - older than 7 days

2025-04-25 11:37:19.019 DEBUG SNAPSHOT_DELETE Snapshot UnraidAppdata at revision 4 to be deleted - older than 7 days

2025-04-25 11:37:19.019 DEBUG SNAPSHOT_DELETE Snapshot UnraidAppdata at revision 5 to be deleted - older than 7 days

2025-04-25 11:37:19.019 DEBUG SNAPSHOT_DELETE Snapshot UnraidAppdata at revision 6 to be deleted - older than 7 days

2025-04-25 11:37:19.019 DEBUG SNAPSHOT_DELETE Snapshot UnraidAppdata at revision 7 to be deleted - older than 7 days

2025-04-25 11:37:19.019 INFO SNAPSHOT_DELETE Deleting snapshot UnraidAppdata at revision 1

2025-04-25 11:37:19.022 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/64/54ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877?select=id,name,size,folder

2025-04-25 11:37:19.419 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/64/54ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877?select=id,name,size,folder

2025-04-25 11:37:19.608 WARN DOWNLOAD_FOSSIL Chunk 6454ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877 is a fossil

2025-04-25 11:37:19.608 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/chunks/64/54ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877.fsl:/content

2025-04-25 11:37:19.867 ERROR DOWNLOAD_CHUNK Failed to download the chunk 6454ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877: 404 The resource could not be found.

Failed to download the chunk 6454ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877: 404 The resource could not be found.

duplicacy_web.log

2025/04/25 11:17:22 172.17.0.1:55245 GET /
2025/04/25 11:17:22 172.17.0.1:55245 GET /assets/css/bootstrap.min.css
2025/04/25 11:17:22 172.17.0.1:55246 GET /assets/css/paper-dashboard.css
2025/04/25 11:17:22 172.17.0.1:55245 GET /assets/css/duplicacy-web.css
2025/04/25 11:17:22 172.17.0.1:55245 GET /assets/css/font-awesome.min.css
2025/04/25 11:17:22 172.17.0.1:55247 GET /assets/js/jquery-1.10.2.min.js
2025/04/25 11:17:22 172.17.0.1:55248 GET /assets/js/jquery.min.js
2025/04/25 11:17:22 172.17.0.1:55249 GET /assets/js/bootbox.min.js
2025/04/25 11:17:22 172.17.0.1:55246 GET /assets/js/bootstrap.min.js
2025/04/25 11:17:22 172.17.0.1:55245 GET /assets/js/axios.min.js
2025/04/25 11:17:22 172.17.0.1:55245 GET /assets/js/chartist.min.js
2025/04/25 11:17:22 172.17.0.1:55246 GET /assets/js/paper-dashboard.js
2025/04/25 11:17:22 172.17.0.1:55249 GET /assets/js/polyfill.min.js
2025/04/25 11:17:22 172.17.0.1:55245 GET /assets/img/product-icon.png
2025/04/25 11:17:23 172.17.0.1:55245 GET /assets/fonts/fontawesome-webfont.woff2?v=4.7.0
2025/04/25 11:17:28 172.17.0.1:55245 GET /schedule
2025/04/25 11:17:28 172.17.0.1:55245 GET /assets/css/bootstrap.min.css
2025/04/25 11:17:28 172.17.0.1:55245 GET /assets/css/paper-dashboard.css
2025/04/25 11:17:28 172.17.0.1:55246 GET /assets/css/duplicacy-web.css
2025/04/25 11:17:28 172.17.0.1:55245 GET /assets/css/font-awesome.min.css
2025/04/25 11:17:28 172.17.0.1:55246 GET /assets/js/jquery-1.10.2.min.js
2025/04/25 11:17:28 172.17.0.1:55245 GET /assets/js/jquery.min.js
2025/04/25 11:17:28 172.17.0.1:55248 GET /assets/js/bootbox.min.js
2025/04/25 11:17:28 172.17.0.1:55247 GET /assets/js/bootstrap.min.js
2025/04/25 11:17:28 172.17.0.1:55249 GET /assets/js/axios.min.js
2025/04/25 11:17:28 172.17.0.1:55245 GET /assets/js/chartist.min.js
2025/04/25 11:17:28 172.17.0.1:55246 GET /assets/js/paper-dashboard.js
2025/04/25 11:17:28 172.17.0.1:55247 GET /assets/js/polyfill.min.js
2025/04/25 11:17:28 172.17.0.1:55248 GET /assets/js/duplicacy-web.js
2025/04/25 11:17:29 172.17.0.1:55245 GET /assets/img/product-icon.png
2025/04/25 11:24:19 172.17.0.1:55245 GET /show_log?name=prune-20250425-040122.log
2025/04/25 11:24:19 172.17.0.1:55245 GET /favicon.ico
2025/04/25 11:36:51 192.168.1.241:55716 GET /
2025/04/25 11:36:51 192.168.1.241:55716 GET /assets/css/bootstrap.min.css
2025/04/25 11:36:51 192.168.1.241:55717 GET /assets/js/jquery-1.10.2.min.js
2025/04/25 11:36:51 192.168.1.241:55720 GET /assets/css/duplicacy-web.css
2025/04/25 11:36:51 192.168.1.241:55721 GET /assets/css/font-awesome.min.css
2025/04/25 11:36:51 192.168.1.241:55719 GET /assets/css/paper-dashboard.css
2025/04/25 11:36:51 192.168.1.241:55718 GET /assets/js/jquery.min.js
2025/04/25 11:36:51 192.168.1.241:55720 GET /assets/js/bootstrap.min.js
2025/04/25 11:36:52 192.168.1.241:55716 GET /assets/js/bootbox.min.js
2025/04/25 11:36:52 192.168.1.241:55721 GET /assets/js/axios.min.js
2025/04/25 11:36:52 192.168.1.241:55716 GET /assets/js/chartist.min.js
2025/04/25 11:36:52 192.168.1.241:55720 GET /assets/js/paper-dashboard.js
2025/04/25 11:36:52 192.168.1.241:55716 GET /assets/js/polyfill.min.js
2025/04/25 11:36:52 192.168.1.241:55719 GET /assets/img/product-icon.png
2025/04/25 11:36:52 192.168.1.241:55716 GET /assets/fonts/fontawesome-webfont.woff2?v=4.7.0
2025/04/25 11:36:55 192.168.1.241:55716 GET /schedule
2025/04/25 11:36:56 192.168.1.241:55716 GET /assets/css/bootstrap.min.css
2025/04/25 11:36:56 192.168.1.241:55719 GET /assets/css/paper-dashboard.css
2025/04/25 11:36:56 192.168.1.241:55717 GET /assets/css/duplicacy-web.css
2025/04/25 11:36:56 192.168.1.241:55718 GET /assets/css/font-awesome.min.css
2025/04/25 11:36:56 192.168.1.241:55720 GET /assets/js/jquery-1.10.2.min.js
2025/04/25 11:36:56 192.168.1.241:55716 GET /assets/js/jquery.min.js
2025/04/25 11:36:56 192.168.1.241:55717 GET /assets/js/bootstrap.min.js
2025/04/25 11:36:56 192.168.1.241:55719 GET /assets/js/bootbox.min.js
2025/04/25 11:36:56 192.168.1.241:55716 GET /assets/js/axios.min.js
2025/04/25 11:36:56 192.168.1.241:55718 GET /assets/js/chartist.min.js
2025/04/25 11:36:56 192.168.1.241:55716 GET /assets/js/paper-dashboard.js
2025/04/25 11:36:56 192.168.1.241:55719 GET /assets/js/polyfill.min.js
2025/04/25 11:36:56 192.168.1.241:55716 GET /assets/js/duplicacy-web.js
2025/04/25 11:36:56 192.168.1.241:55716 GET /assets/img/product-icon.png
2025/04/25 11:36:56 192.168.1.241:55719 GET /assets/img/product-icon.png
2025/04/25 11:36:56 192.168.1.241:55716 GET /assets/img/product-icon.png
2025/04/25 11:37:03 192.168.1.241:55716 POST /start_stop_schedule
2025/04/25 11:37:03 Starting schedule Prune ad-hoc
2025/04/25 11:37:03 Created log file /logs/prune-20250425-113703.log
2025/04/25 11:37:03 Running /home/duplicacy/.duplicacy-web/bin/duplicacy_linux_x64_3.2.3 [-log -d prune -storage OneDrive -keep 0:7 -a]
2025/04/25 11:37:03 Set current working directory to /cache/localhost/all
2025/04/25 11:37:19 ERROR DOWNLOAD_CHUNK Failed to download the chunk 6454ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877: 404 The resource could not be found.
2025/04/25 11:37:22 192.168.1.241:55730 GET /schedule
2025/04/25 11:37:23 192.168.1.241:55730 GET /assets/css/bootstrap.min.css
2025/04/25 11:37:23 192.168.1.241:55731 GET /assets/css/paper-dashboard.css
2025/04/25 11:37:23 192.168.1.241:55732 GET /assets/css/duplicacy-web.css
2025/04/25 11:37:23 192.168.1.241:55734 GET /assets/js/jquery-1.10.2.min.js
2025/04/25 11:37:23 192.168.1.241:55733 GET /assets/css/font-awesome.min.css
2025/04/25 11:37:23 192.168.1.241:55735 GET /assets/js/jquery.min.js
2025/04/25 11:37:23 192.168.1.241:55730 GET /assets/js/bootstrap.min.js
2025/04/25 11:37:23 192.168.1.241:55732 GET /assets/js/bootbox.min.js
2025/04/25 11:37:23 192.168.1.241:55730 GET /assets/js/axios.min.js
2025/04/25 11:37:23 192.168.1.241:55732 GET /assets/js/chartist.min.js
2025/04/25 11:37:23 192.168.1.241:55733 GET /assets/js/paper-dashboard.js
2025/04/25 11:37:23 192.168.1.241:55730 GET /assets/js/polyfill.min.js
2025/04/25 11:37:23 192.168.1.241:55731 GET /assets/js/duplicacy-web.js
2025/04/25 11:37:23 192.168.1.241:55730 GET /assets/img/product-icon.png
2025/04/25 11:37:23 192.168.1.241:55730 GET /assets/fonts/fontawesome-webfont.woff2?v=4.7.0
2025/04/25 11:37:23 192.168.1.241:55730 GET /assets/img/product-icon.png
2025/04/25 11:37:23 192.168.1.241:55731 GET /assets/img/product-icon.png
2025/04/25 11:37:30 192.168.1.241:55730 GET /show_log?name=prune-20250425-113703.log
2025/04/25 11:37:30 192.168.1.241:55730 GET /favicon.ico

[saspus]

@marcnijman

2025-04-25 11:37:19.019 INFO SNAPSHOT_DELETE Deleting snapshot UnraidAppdata at revision 1
2025-04-25 11:37:19.022 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/chunks/64/54ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877?select=id,name,size,folder
2025-04-25 11:37:19.419 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/root:/Duplicacy/fossils/64/54ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877?select=id,name,size,folder
2025-04-25 11:37:19.608 WARN DOWNLOAD_FOSSIL Chunk 6454ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877 is a fossil
2025-04-25 11:37:19.608 DEBUG ONEDRIVE_CALL GET ://api.onedrive.com/v1.0/drive/items/root:/Duplicacy/chunks/64/54ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877.fsl:/content
2025-04-25 11:37:19.867 ERROR DOWNLOAD_CHUNK Failed to download the chunk 6454ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877: 404 The resource could not be found.

This is weird.

So, it declares that snapshot 1 has to be deleted. duplicacy/src/duplicacy_snapshotmanager.go at 065ae50868574404c502fb8b9508a2475d218337 · gilbertchen/duplicacy · GitHub)

Then it attempts to download the chunk 54ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877, confirms that it exists, and notes, that it’s a fossil (duplicacy/src/duplicacy_chunkoperator.go at 065ae50868574404c502fb8b9508a2475d218337 · gilbertchen/duplicacy · GitHub)

Then actual download of the file that was just confirmed to exist, fails.

@gchen, is that some API compatibility issues or OneDrive shenanigans?

[unplowed5107]

I have the same exact issue. I wonder if this is OneDrive problem…

2025-04-27 15:41:37.219 INFO SNAPSHOT_DELETE Deleting snapshot appdata at revision 2
2025-04-27 15:41:37.230 DEBUG ONEDRIVE_CALL GET https://api.onedrive.com/v1.0/drive/root:/unraid-backup-duplicacy/chunks/66/a224a5a6e1bb9c6371d5fe317b21bd83fca5121e0573f8ed45a94170388a15?select=id,name,size,folder
2025-04-27 15:41:37.710 DEBUG ONEDRIVE_CALL GET https://api.onedrive.com/v1.0/drive/root:/unraid-backup-duplicacy/fossils/66/a224a5a6e1bb9c6371d5fe317b21bd83fca5121e0573f8ed45a94170388a15?select=id,name,size,folder
2025-04-27 15:41:38.133 WARN DOWNLOAD_FOSSIL Chunk 66a224a5a6e1bb9c6371d5fe317b21bd83fca5121e0573f8ed45a94170388a15 is a fossil
2025-04-27 15:41:38.133 DEBUG ONEDRIVE_CALL GET https://api.onedrive.com/v1.0/drive/items/root:/unraid-backup-duplicacy/chunks/66/a224a5a6e1bb9c6371d5fe317b21bd83fca5121e0573f8ed45a94170388a15.fsl:/content
2025-04-27 15:41:38.994 ERROR DOWNLOAD_CHUNK Failed to download the chunk 66a224a5a6e1bb9c6371d5fe317b21bd83fca5121e0573f8ed45a94170388a15: 404 The resource could not be found.
Failed to download the chunk 66a224a5a6e1bb9c6371d5fe317b21bd83fca5121e0573f8ed45a94170388a15: 404 The resource could not be found.

[unplowed5107]

So I deleted all the revisions except the last 3 revisions. (I have other forms of of backup so this is no issue). Now, the check runs fine.

Something similar happened as well when I was using Kopia last year. I thought it was Kopia issue so I switched to Duplicacy.

Will wait and see if this happens again. I am considering either Storj or B2.

[gchen]

I’m looking at this now. I think it is a bug in the OneDrive storage backend, not a OneDrive issue.

[gchen]

I checked in a commit that should fix this issue: OneDrive: use correct parent reference when moving files · gilbertchen/duplicacy@df76bd0 · GitHub

It looks like OneDrive now requires /drive/root: as the prefix for path-based addressing, rather than /root:. Therefore, Duplicacy couldn’t move the chunk the chunks subdirectory to the fossils subdirectory when attempting to mark it as a fossil.

This commit also fixed another bug where a fossil couldn’t be downloaded because the file path wasn’t converted properly.

[marcnijman]

Sounds good, would love to check it out.
I’m using a duplicacy-web container, which is based on duplicacy web, I don’t think the fix is already in here, is that correct?

If so, what can we expect with regards to when this fix will be included?
Don’t mean to hurry or tell you it’s taking too long - not at all, response and fix rate is great in my opinion - but just to get an idea.

[gchen]

I made a new CLI release 3.2.5 that includes this fix: Releases · gilbertchen/duplicacy · GitHub

[marcnijman]

Manually copied the 3.2.5 version in the container, ran a prune (completed, with a 404’s ignored) and a check (failed with missing chunks), see logs below.

Prune
Check

I hoped both would run successful and the daily backup could resume, not sure if this is according to your expectations, would be appreciated if you could have a look.

[marcnijman]

Tried getting the backup running again, without succes so far:
20250506_2110_CheckPersist
20250506_2116_PruneExhaustiveExclusive

After these I cleared the cache:
20250507_0921_PostClearCache_CheckPersist
20250507_0924_PostClearCache_PruneExhaustiveExclusive
20250507_0927_PostClearCache_CheckPersist

Any suggestions on how to get the backup running again are highly appreciated!

[fronesis]

I’m sorry I can’t help. But your struggles lead me to wonder aloud: is anyone out there using OneDrive as a backend consistently avoiding errors?

I tried an initial setup to OneDrive Business and it was a total mess. Throttling, rate-limiting, and other errors nonstop. I gave up quickly and switched to GCS, which after one mis-step that I’m pretty sure was my fault, has been working great.

[saspus]

I would manually delete bad snapshot revisions (add -persist and -resurrect to check to find all of them in one go) – they were supposed to be pruned away anyway), then ensure no other duplicacy is touching the store and run prune -a -exhaustive -exclusive to delete any remanning orphans.

[saspus]

@fronesis

is anyone out there using OneDrive as a backend consistently avoiding errors?

These *drive based backends cannot be expected to work well in the scenarios they were not designed to be used in. Prior discussion:

(Newbie) Backup entire machine?

Yes. As an example, directory enumeration with multiple files inside (think chunks subfolder) maybe be/is throttled, or otherwise rate limited, either on purpose to discourage bulk storage or simply by not being optimized for such usecase. Dropbox is the worst in this regard. Even without the neee to get into technical details you can just go by a general principle that it is always best when your goals and incentives are aligned with that of your service provider. Services like Dropbox, OneD…

[marcnijman]

Doesn’t seem to do much (different):

Running check command from /cache/localhost/all
Options: [-log check -storage OneDrive -a -tabular -persist -resurrect -a -tabular]
2025-05-08 08:15:17.228 INFO STORAGE_SET Storage set to one://Duplicacy
2025-05-08 08:15:26.204 INFO SNAPSHOT_CHECK Listing all chunks
2025-05-08 08:17:08.211 INFO SNAPSHOT_CHECK 1 snapshots and 27 revisions
2025-05-08 08:17:08.211 INFO SNAPSHOT_CHECK Total chunk size is 1,219M in 275 chunks
2025-05-08 08:17:08.677 WARN DOWNLOAD_CHUNK Chunk 6454ff8a44637668a8138a75e57be2a2f194d01b43e24958f22c8c140e380877 can't be found
2025-05-08 08:17:08.678 ERROR SNAPSHOT_CHUNK Failed to load chunks for snapshot UnraidAppdata at revision 1: unexpected end of JSON input
Failed to load chunks for snapshot UnraidAppdata at revision 1: unexpected end of JSON input

[Droolio]

Looks like you have a missing metadata chunk in revision 1. IMO the only way to fix this is to delete all revisions for the snapshot ID, clear your local cache, then run a fresh backup. It’ll take longer but it won’t spend time re-uploading chunks.

However, DO NOT run a prune to clean-up yet, as you want most of the chunks to stay until they’re properly referenced. You should only clean up after you’ve got a good revision.

[karateviktor]

Hello, I ran into the same issue with the web version.
I tried both:
hotio/duplicacy:latest
https://hub.docker.com/r/saspus/duplicacy-web latest

and both use an older cli version =>
/config/bin/duplicacy_linux_x64_3.2.3

Do you know if that is an issue with the dockercontainers or the web version?

[saspus]

CLI version Web UI uses is determined by https://duplicacy.com/latest_cli_version

You can override it

Disable automatic duplicacy CLI update

You can set the CLI version in ~/.duplicacy-web/duplicacy.json: { ... "cli_version": "2.7.2", ... } Then the web GUI will stick to this version. By default this key has an empty value and the web GUI will visit https://duplicacy.com/latest_cli_version to retrieve the stable/latest version. You’ll need to restart the web GUI for the change to take effect.

[marcnijman]

Another update, I took the advice of @Droolio, although I didn’t delete all revisions. I had revision 1 till 31 in onedrive and removed 1 to 10: check failed, removed 11 to 20: check successful.
log

Ran a successfull prune as well.
log

Decided to run the entire schedule (backup, check & prune), backup completed, both check & prune failed.

Backup
Check
Prune

I realized only afterwards that the prune after the successful check didn’t have the debug parameter, however still wanted to share the results.
Although this prune states in the log it removed revision 21 till 24, these are still present in one-drive.