Weird behavior failing drives.... anyone else seen this?

Support
#1

So i use this product on a pc that acts as a makeshift file server

The drive was kicking out S.M.A.R.T errors for about 2 weeks before it kicked the bucket

I started going through the logs and i noticed that duplicacy started to upload files to the cloud from 2010 … it basically started from scratch uploading old files… which completely screwed me because for about a month all of the files that had recently been added or changed were not uploading to the cloud

I thought as first the files we perhaps moved from one folder to another… but they werent…

What would cause this?? Failed snapshot?

#2

the files are uploading to one drive now… in the duplicacy logs folder

#3

Duplicacy always uses the last backup as the base line to identify new or modified file, so if there are a lot of files missing from the last backup for some reason then Duplicacy will process all these files as new files.

#4

but they werent missing… the backup previous to that only uploaded 2 files and they were current…

#5

As I understood the OP, the point is that duplicacy starts with the oldest files when uploading, which means that during the initial backup (which can take weeks) your current (and usually most important files) may not be backed up for a long time (didn’t we discuss this problem previously? I can’t find it right now).

#7

here is the thing that is weird… i only showed the logs of larger ones where it went crazy backing up stuff it already had…

if you look at the log before or the log after there are 1 or 2 items and that’s it…

what about a drive dying or bad blocks makes this program try to restart the backup from the oldest items to the newest… that is a serious flaw…

#8

Any error in the logs that have only 1 or 2 items? Can you post them here?

#9 
2019-06-08 08:02:29.708 INFO STORAGE_SET Storage set to b2://ChattelINC
2019-06-08 08:03:01.053 INFO BACKUP_START Last backup at revision 7548 found
2019-06-08 08:03:01.054 INFO VSS_CREATE Creating a shadow copy for D:\
2019-06-08 08:06:05.331 INFO VSS_DONE Shadow copy {CB3D7EB3-FE50-4FFB-A139-98B0F5A7E3CA} created
2019-06-08 08:06:05.332 INFO BACKUP_INDEXING Indexing D:\
2019-06-08 08:06:05.333 INFO SNAPSHOT_FILTER Loaded 3 include/exclude pattern(s)
2019-06-08 08:16:45.822 INFO BACKUP_THREADS Use 32 uploading threads
2019-06-08 08:16:45.917 INFO UPLOAD_PROGRESS Skipped chunk 2 size 2971964, 2.83MB/s 00:08:19 0.2%
2019-06-08 08:16:46.086 INFO UPLOAD_PROGRESS Skipped chunk 3 size 14791721, 16.94MB/s 00:01:23 1.1%
2019-06-08 08:16:46.127 INFO UPLOAD_PROGRESS Skipped chunk 4 size 4160362, 20.91MB/s 00:01:07 1.4%
2019-06-08 08:16:46.156 INFO UPLOAD_PROGRESS Skipped chunk 5 size 2817118, 23.60MB/s 00:01:00 1.6%
2019-06-08 08:16:46.184 INFO UPLOAD_PROGRESS Skipped chunk 6 size 2970435, 26.43MB/s 00:00:53 1.8%
2019-06-08 08:16:46.212 INFO UPLOAD_PROGRESS Skipped chunk 7 size 2829235, 29.13MB/s 00:00:48 2.0%
2019-06-08 08:16:46.227 INFO UPLOAD_PROGRESS Skipped chunk 8 size 1749837, 30.79MB/s 00:00:46 2.1%
2019-06-08 08:16:46.248 INFO UPLOAD_PROGRESS Skipped chunk 9 size 2185096, 32.88MB/s 00:00:43 2.3%
2019-06-08 08:16:46.261 INFO UPLOAD_PROGRESS Skipped chunk 10 size 1693739, 34.49MB/s 00:00:41 2.4%
2019-06-08 08:16:46.337 INFO UPLOAD_PROGRESS Skipped chunk 11 size 7158824, 41.32MB/s 00:00:34 2.9%
2019-06-08 08:16:46.369 INFO UPLOAD_PROGRESS Skipped chunk 12 size 1283365, 42.55MB/s 00:00:33 3.0%
2019-06-08 08:16:46.453 INFO UPLOAD_PROGRESS Skipped chunk 13 size 8111950, 50.28MB/s 00:00:28 3.5%
2019-06-08 08:16:46.583 INFO UPLOAD_PROGRESS Skipped chunk 14 size 11896609, 61.63MB/s 00:00:22 4.3%
2019-06-08 08:16:46.764 INFO UPLOAD_PROGRESS Skipped chunk 15 size 16777216, 77.63MB/s 00:00:18 5.4%
2019-06-08 08:16:46.848 INFO UPLOAD_PROGRESS Skipped chunk 16 size 7888015, 85.15MB/s 00:00:16 6.0%
2019-06-08 08:16:46.875 INFO UPLOAD_PROGRESS Skipped chunk 17 size 2965385, 87.98MB/s 00:00:16 6.2%
2019-06-08 08:16:46.892 INFO UPLOAD_PROGRESS Skipped chunk 18 size 1937123, 89.82MB/s 00:00:15 6.3%
2019-06-08 08:16:46.925 INFO UPLOAD_PROGRESS Skipped chunk 19 size 3260136, 92.93MB/s 00:00:15 6.5%
2019-06-08 08:16:46.962 INFO UPLOAD_PROGRESS Skipped chunk 20 size 3965560, 96.72MB/s 00:00:14 6.8%
2019-06-08 08:16:47.078 INFO UPLOAD_PROGRESS Skipped chunk 21 size 10686034, 53.45MB/s 00:00:25 7.5%
2019-06-08 08:16:47.133 INFO UPLOAD_PROGRESS Skipped chunk 22 size 5398851, 56.03MB/s 00:00:24 7.9%
2019-06-08 08:16:47.309 INFO UPLOAD_PROGRESS Skipped chunk 23 size 16537094, 63.91MB/s 00:00:21 9.0%
2019-06-08 08:16:47.360 INFO UPLOAD_PROGRESS Skipped chunk 24 size 4862049, 66.23MB/s 00:00:20 9.3%
2019-06-08 08:16:47.492 INFO UPLOAD_PROGRESS Skipped chunk 25 size 12203653, 72.05MB/s 00:00:18 10.1%
2019-06-08 08:16:47.584 INFO UPLOAD_PROGRESS Skipped chunk 26 size 3239408, 73.60MB/s 00:00:18 10.3%
2019-06-08 08:16:47.623 INFO UPLOAD_PROGRESS Skipped chunk 27 size 4188334, 75.59MB/s 00:00:17 10.6%
2019-06-08 08:16:47.652 INFO UPLOAD_PROGRESS Skipped chunk 28 size 2293849, 76.69MB/s 00:00:17 10.8%
2019-06-08 08:16:47.853 INFO UPLOAD_PROGRESS Skipped chunk 29 size 16777216, 84.69MB/s 00:00:15 11.9%
2019-06-08 08:16:47.975 INFO UPLOAD_PROGRESS Skipped chunk 30 size 11365531, 90.11MB/s 00:00:14 12.7%
2019-06-08 08:16:47.996 INFO UPLOAD_PROGRESS Skipped chunk 31 size 2236896, 91.17MB/s 00:00:14 12.8%
2019-06-08 08:16:48.017 INFO UPLOAD_PROGRESS Skipped chunk 32 size 2222119, 61.49MB/s 00:00:21 13.0%
2019-06-08 08:16:48.066 INFO UPLOAD_PROGRESS Skipped chunk 33 size 5105614, 63.11MB/s 00:00:20 13.3%
2019-06-08 08:16:48.081 INFO UPLOAD_PROGRESS Skipped chunk 34 size 1670469, 63.64MB/s 00:00:20 13.4%
2019-06-08 08:16:48.125 INFO UPLOAD_PROGRESS Skipped chunk 35 size 4259083, 65.00MB/s 00:00:19 13.7%
2019-06-08 08:16:48.133 INFO UPLOAD_PROGRESS Skipped chunk 36 size 1181332, 65.37MB/s 00:00:19 13.8%
2019-06-08 08:16:48.286 INFO UPLOAD_PROGRESS Skipped chunk 37 size 14547654, 70.00MB/s 00:00:18 14.8%
2019-06-08 08:16:48.308 INFO UPLOAD_PROGRESS Skipped chunk 38 size 2182707, 70.69MB/s 00:00:18 14.9%
2019-06-08 08:16:48.317 INFO UPLOAD_PROGRESS Skipped chunk 39 size 1352241, 71.12MB/s 00:00:17 15.0%
2019-06-08 08:16:48.389 INFO UPLOAD_PROGRESS Skipped chunk 40 size 7016529, 73.35MB/s 00:00:17 15.5%
2019-06-08 08:16:48.481 INFO UPLOAD_PROGRESS Skipped chunk 41 size 8575950, 76.08MB/s 00:00:16 16.1%
2019-06-08 08:16:48.518 INFO UPLOAD_PROGRESS Skipped chunk 42 size 4027973, 77.36MB/s 00:00:16 16.3%
2019-06-08 08:16:48.652 INFO UPLOAD_PROGRESS Skipped chunk 43 size 12494579, 81.33MB/s 00:00:15 17.2%
2019-06-08 08:16:48.688 INFO UPLOAD_PROGRESS Skipped chunk 44 size 3590531, 82.47MB/s 00:00:15 17.4%
2019-06-08 08:16:48.780 INFO UPLOAD_PROGRESS Skipped chunk 45 size 8233769, 85.09MB/s 00:00:14 18.0%
2019-06-08 08:16:48.797 INFO UPLOAD_PROGRESS Skipped chunk 46 size 2014050, 85.73MB/s 00:00:14 18.1%
2019-06-08 08:16:48.895 INFO UPLOAD_PROGRESS Skipped chunk 47 size 9340486, 88.70MB/s 00:00:13 18.7%
2019-06-08 08:16:48.909 INFO UPLOAD_PROGRESS Skipped chunk 48 size 1603711, 89.21MB/s 00:00:13 18.8%
2019-06-08 08:16:48.937 INFO UPLOAD_PROGRESS Skipped chunk 49 size 3108432, 90.20MB/s 00:00:13 19.1%
2019-06-08 08:16:48.950 INFO UPLOAD_PROGRESS Skipped chunk 50 size 1438351, 90.65MB/s 00:00:13 19.1%
2019-06-08 08:16:48.959 INFO UPLOAD_PROGRESS Skipped chunk 51 size 1239991, 91.05MB/s 00:00:13 19.2%
2019-06-08 08:16:49.133 INFO UPLOAD_PROGRESS Skipped chunk 52 size 16200777, 72.15MB/s 00:00:16 20.3%
2019-06-08 08:16:49.141 INFO UPLOAD_PROGRESS Skipped chunk 53 size 1054231, 72.40MB/s 00:00:16 20.4%
2019-06-08 08:16:49.162 INFO UPLOAD_PROGRESS Skipped chunk 54 size 2424153, 72.98MB/s 00:00:16 20.6%
2019-06-08 08:16:49.169 INFO UPLOAD_PROGRESS Skipped chunk 55 size 1081586, 73.23MB/s 00:00:16 20.6%
2019-06-08 08:16:49.227 INFO UPLOAD_PROGRESS Skipped chunk 56 size 5887137, 74.64MB/s 00:00:15 21.0%
2019-06-08 08:16:49.252 INFO UPLOAD_PROGRESS Skipped chunk 57 size 2687022, 75.28MB/s 00:00:15 21.2%
2019-06-08 08:16:49.272 INFO UPLOAD_PROGRESS Skipped chunk 58 size 2122499, 75.79MB/s 00:00:15 21.3%
2019-06-08 08:16:49.355 INFO UPLOAD_PROGRESS Skipped chunk 59 size 8195505, 77.74MB/s 00:00:15 21.9%
2019-06-08 08:16:49.468 INFO UPLOAD_PROGRESS Skipped chunk 60 size 10515396, 80.25MB/s 00:00:14 22.6%
2019-06-08 08:16:49.652 INFO UPLOAD_PROGRESS Skipped chunk 61 size 13262432, 83.41MB/s 00:00:13 23.5%
2019-06-08 08:16:49.721 INFO UPLOAD_PROGRESS Skipped chunk 62 size 6673277, 85.00MB/s 00:00:13 24.0%
2019-06-08 08:16:49.730 INFO UPLOAD_PROGRESS Skipped chunk 63 size 1114701, 85.26MB/s 00:00:13 24.0%
2019-06-08 08:16:49.748 INFO UPLOAD_PROGRESS Skipped chunk 64 size 2159126, 85.78MB/s 00:00:13 24.2%
2019-06-08 08:16:49.840 INFO UPLOAD_PROGRESS Skipped chunk 65 size 8951237, 87.91MB/s 00:00:13 24.8%
2019-06-08 08:16:49.851 INFO UPLOAD_PROGRESS Skipped chunk 66 size 1307502, 88.23MB/s 00:00:13 24.9%
2019-06-08 08:16:49.894 INFO UPLOAD_PROGRESS Skipped chunk 67 size 4327091, 89.26MB/s 00:00:12 25.2%
2019-06-08 08:16:49.943 INFO UPLOAD_PROGRESS Skipped chunk 68 size 5142386, 90.48MB/s 00:00:12 25.5%
2019-06-08 08:16:50.131 INFO UPLOAD_PROGRESS Skipped chunk 69 size 16777216, 75.59MB/s 00:00:14 26.6%
2019-06-08 08:16:50.252 INFO UPLOAD_PROGRESS Skipped chunk 70 size 11419429, 77.76MB/s 00:00:14 27.4%
2019-06-08 08:16:50.269 INFO UPLOAD_PROGRESS Skipped chunk 71 size 1997343, 78.15MB/s 00:00:14 27.5%
2019-06-08 08:16:50.353 INFO UPLOAD_PROGRESS Skipped chunk 72 size 8038314, 79.68MB/s 00:00:13 28.1%
2019-06-08 08:16:50.381 INFO UPLOAD_PROGRESS Skipped chunk 73 size 3036535, 80.26MB/s 00:00:13 28.3%
2019-06-08 08:16:50.532 INFO UPLOAD_PROGRESS Skipped chunk 74 size 13972256, 82.92MB/s 00:00:13 29.2%
2019-06-08 08:16:50.615 INFO UPLOAD_PROGRESS Skipped chunk 75 size 8125305, 84.47MB/s 00:00:12 29.8%
2019-06-08 08:16:50.627 INFO UPLOAD_PROGRESS Skipped chunk 76 size 1491702, 84.76MB/s 00:00:12 29.9%
2019-06-08 08:16:50.660 INFO UPLOAD_PROGRESS Skipped chunk 77 size 3382131, 85.40MB/s 00:00:12 30.1%
2019-06-08 08:16:50.733 INFO UPLOAD_PROGRESS Skipped chunk 78 size 7253720, 86.79MB/s 00:00:12 30.6%
2019-06-08 08:16:50.784 INFO UPLOAD_PROGRESS Skipped chunk 79 size 5178692, 87.77MB/s 00:00:12 30.9%
2019-06-08 08:16:50.834 INFO UPLOAD_PROGRESS Skipped chunk 80 size 4950559, 88.72MB/s 00:00:11 31.3%
2019-06-08 08:16:50.855 INFO UPLOAD_PROGRESS Skipped chunk 81 size 2169684, 89.13MB/s 00:00:11 31.4%
2019-06-08 08:16:50.879 INFO UPLOAD_PROGRESS Skipped chunk 82 size 2814874, 89.67MB/s 00:00:11 31.6%
2019-06-08 08:16:50.904 INFO UPLOAD_PROGRESS Skipped chunk 83 size 2629468, 90.17MB/s 00:00:11 31.8%
2019-06-08 08:16:50.958 INFO UPLOAD_PROGRESS Skipped chunk 84 size 5256153, 91.17MB/s 00:00:11 32.1%
2019-06-08 08:16:51.004 INFO UPLOAD_PROGRESS Skipped chunk 85 size 4809697, 76.74MB/s 00:00:13 32.5%
2019-06-08 08:16:51.019 INFO UPLOAD_PROGRESS Skipped chunk 86 size 1778807, 77.02MB/s 00:00:13 32.6%
2019-06-08 08:16:51.074 INFO UPLOAD_PROGRESS Skipped chunk 87 size 5290087, 77.87MB/s 00:00:13 32.9%
2019-06-08 08:16:51.084 INFO UPLOAD_PROGRESS Skipped chunk 88 size 1363540, 78.08MB/s 00:00:13 33.0%
2019-06-08 08:16:51.105 INFO UPLOAD_PROGRESS Skipped chunk 89 size 2268796, 78.44MB/s 00:00:13 33.2%
2019-06-08 08:16:51.198 INFO UPLOAD_PROGRESS Skipped chunk 90 size 9024999, 79.88MB/s 00:00:12 33.8%
2019-06-08 08:16:51.258 INFO UPLOAD_PROGRESS Skipped chunk 91 size 6026089, 80.83MB/s 00:00:12 34.2%
2019-06-08 08:16:51.349 INFO UPLOAD_PROGRESS Skipped chunk 92 size 8688550, 82.22MB/s 00:00:12 34.8%
2019-06-08 08:16:51.373 INFO UPLOAD_PROGRESS Skipped chunk 93 size 2692684, 82.64MB/s 00:00:12 35.0%
2019-06-08 08:16:51.401 INFO UPLOAD_PROGRESS Skipped chunk 94 size 3046233, 83.13MB/s 00:00:12 35.2%
2019-06-08 08:16:51.459 INFO UPLOAD_PROGRESS Skipped chunk 95 size 5675102, 84.03MB/s 00:00:11 35.5%
2019-06-08 08:16:51.476 INFO UPLOAD_PROGRESS Skipped chunk 96 size 2070957, 84.36MB/s 00:00:11 35.7%
2019-06-08 08:16:51.579 INFO UPLOAD_PROGRESS Skipped chunk 97 size 5033136, 85.16MB/s 00:00:11 36.0%
2019-06-08 08:16:51.804 INFO UPLOAD_PROGRESS Skipped chunk 98 size 16777216, 87.83MB/s 00:00:11 37.1%
2019-06-08 08:16:51.844 INFO UPLOAD_PROGRESS Skipped chunk 99 size 4081430, 88.47MB/s 00:00:11 37.4%
2019-06-08 08:16:51.858 INFO UPLOAD_PROGRESS Skipped chunk 100 size 1532838, 88.72MB/s 00:00:10 37.5%
2019-06-08 08:16:51.868 INFO UPLOAD_PROGRESS Skipped chunk 101 size 1357556, 88.93MB/s 00:00:10 37.6%
2019-06-08 08:16:51.916 INFO UPLOAD_PROGRESS Skipped chunk 102 size 4856548, 89.71MB/s 00:00:10 37.9%
2019-06-08 08:16:51.944 INFO UPLOAD_PROGRESS Skipped chunk 103 size 3078067, 90.20MB/s 00:00:10 38.2%
2019-06-08 08:16:51.982 INFO UPLOAD_PROGRESS Skipped chunk 104 size 3722343, 90.79MB/s 00:00:10 38.4%
2019-06-08 08:16:52.088 INFO UPLOAD_PROGRESS Skipped chunk 105 size 10104062, 79.19MB/s 00:00:11 39.1%
2019-06-08 08:16:52.110 INFO UPLOAD_PROGRESS Skipped chunk 106 size 2244497, 79.50MB/s 00:00:11 39.2%
2019-06-08 08:16:52.132 INFO UPLOAD_PROGRESS Skipped chunk 107 size 2362623, 79.82MB/s 00:00:11 39.4%
2019-06-08 08:16:52.221 INFO UPLOAD_PROGRESS Skipped chunk 108 size 8448196, 80.97MB/s 00:00:11 40.0%
2019-06-08 08:16:52.243 INFO UPLOAD_PROGRESS Skipped chunk 109 size 2441672, 81.31MB/s 00:00:11 40.1%
2019-06-08 08:16:52.390 INFO UPLOAD_PROGRESS Skipped chunk 110 size 13365913, 83.13MB/s 00:00:11 41.0%
2019-06-08 08:16:52.413 INFO UPLOAD_PROGRESS Skipped chunk 111 size 2393221, 83.45MB/s 00:00:10 41.2%
2019-06-08 08:16:52.506 INFO UPLOAD_PROGRESS Skipped chunk 112 size 8789661, 84.65MB/s 00:00:10 41.8%
2019-06-08 08:16:52.551 INFO UPLOAD_PROGRESS Skipped chunk 113 size 4296960, 85.24MB/s 00:00:10 42.1%
2019-06-08 08:16:52.561 INFO UPLOAD_PROGRESS Skipped chunk 114 size 1453731, 85.43MB/s 00:00:10 42.2%
2019-06-08 08:16:52.633 INFO UPLOAD_PROGRESS Skipped chunk 115 size 6898235, 86.37MB/s 00:00:10 42.6%
2019-06-08 08:16:52.669 INFO UPLOAD_PROGRESS Skipped chunk 116 size 3513159, 86.85MB/s 00:00:10 42.9%
2019-06-08 08:16:52.753 INFO UPLOAD_PROGRESS Skipped chunk 117 size 8111641, 87.96MB/s 00:00:10 43.4%
2019-06-08 08:16:52.804 INFO UPLOAD_PROGRESS Skipped chunk 118 size 5067871, 88.65MB/s 00:00:09 43.8%
2019-06-08 08:16:52.877 INFO UPLOAD_PROGRESS Skipped chunk 119 size 6930978, 89.59MB/s 00:00:09 44.2%
2019-06-08 08:16:52.934 INFO UPLOAD_PROGRESS Skipped chunk 120 size 5300433, 90.31MB/s 00:00:09 44.6%
2019-06-08 08:16:52.959 INFO UPLOAD_PROGRESS Skipped chunk 121 size 2904980, 90.71MB/s 00:00:09 44.8%
2019-06-08 08:16:52.976 INFO UPLOAD_PROGRESS Skipped chunk 122 size 1886307, 90.97MB/s 00:00:09 44.9%
2019-06-08 08:16:53.134 INFO UPLOAD_PROGRESS Skipped chunk 123 size 14370143, 81.31MB/s 00:00:10 45.9%
2019-06-08 08:16:53.155 INFO UPLOAD_PROGRESS Skipped chunk 124 size 2112098, 81.56MB/s 00:00:10 46.0%
2019-06-08 08:16:53.166 INFO UPLOAD_PROGRESS Skipped chunk 125 size 1484041, 81.74MB/s 00:00:10 46.1%
2019-06-08 08:16:53.176 INFO UPLOAD_PROGRESS Skipped chunk 126 size 1187348, 81.88MB/s 00:00:10 46.2%
2019-06-08 08:16:53.220 INFO UPLOAD_PROGRESS Skipped chunk 127 size 4382324, 82.40MB/s 00:00:10 46.5%
2019-06-08 08:16:53.247 INFO UPLOAD_PROGRESS Skipped chunk 128 size 3138035, 82.78MB/s 00:00:10 46.7%
2019-06-08 08:16:53.271 INFO UPLOAD_PROGRESS Skipped chunk 129 size 2282979, 83.05MB/s 00:00:10 46.9%
2019-06-08 08:16:53.296 INFO UPLOAD_PROGRESS Skipped chunk 130 size 2748473, 83.38MB/s 00:00:09 47.0%
2019-06-08 08:16:53.461 INFO UPLOAD_PROGRESS Skipped chunk 131 size 14868900, 85.15MB/s 00:00:09 48.0%
2019-06-08 08:16:53.507 INFO UPLOAD_PROGRESS Skipped chunk 132 size 4611835, 85.70MB/s 00:00:09 48.3%
2019-06-08 08:16:53.581 INFO UPLOAD_PROGRESS Skipped chunk 133 size 3293454, 86.09MB/s 00:00:09 48.6%
2019-06-08 08:16:53.613 INFO UPLOAD_PROGRESS Skipped chunk 134 size 1490166, 86.27MB/s 00:00:09 48.7%
2019-06-08 08:16:53.647 INFO UPLOAD_PROGRESS Skipped chunk 135 size 3353797, 86.67MB/s 00:00:09 48.9%
2019-06-08 08:16:53.702 INFO UPLOAD_PROGRESS Skipped chunk 136 size 5279024, 87.30MB/s 00:00:09 49.3%
2019-06-08 08:16:53.712 INFO UPLOAD_PROGRESS Skipped chunk 137 size 1338998, 87.46MB/s 00:00:09 49.3%
2019-06-08 08:16:53.717 INFO UPLOAD_PROGRESS Uploaded chunk 1 size 5973655, 88.17MB/s 00:00:09 49.7%
2019-06-08 08:16:53.819 INFO UPLOAD_PROGRESS Skipped chunk 138 size 10266324, 89.39MB/s 00:00:08 50.4%
2019-06-08 08:16:53.924 INFO UPLOAD_PROGRESS Skipped chunk 139 size 9307697, 90.50MB/s 00:00:08 51.1%
2019-06-08 08:16:54.040 INFO UPLOAD_PROGRESS Skipped chunk 140 size 10493072, 81.56MB/s 00:00:09 51.8%
2019-06-08 08:16:54.099 INFO UPLOAD_PROGRESS Skipped chunk 141 size 5916465, 82.19MB/s 00:00:09 52.2%
2019-06-08 08:16:54.126 INFO UPLOAD_PROGRESS Skipped chunk 142 size 2976169, 82.50MB/s 00:00:09 52.4%
2019-06-08 08:16:54.138 INFO UPLOAD_PROGRESS Skipped chunk 143 size 1248548, 82.63MB/s 00:00:09 52.4%
2019-06-08 08:16:54.317 INFO UPLOAD_PROGRESS Skipped chunk 144 size 16777216, 84.41MB/s 00:00:08 53.6%
2019-06-08 08:16:54.450 INFO UPLOAD_PROGRESS Skipped chunk 145 size 12202276, 85.70MB/s 00:00:08 54.4%
2019-06-08 08:16:54.571 INFO UPLOAD_PROGRESS Skipped chunk 146 size 11354802, 86.91MB/s 00:00:08 55.2%
2019-06-08 08:16:54.596 INFO UPLOAD_PROGRESS Skipped chunk 147 size 2592878, 87.18MB/s 00:00:08 55.3%
2019-06-08 08:16:54.669 INFO UPLOAD_PROGRESS Skipped chunk 148 size 6876704, 87.91MB/s 00:00:08 55.8%
2019-06-08 08:16:54.756 INFO UPLOAD_PROGRESS Skipped chunk 149 size 8247725, 88.78MB/s 00:00:07 56.4%
2019-06-08 08:16:54.784 INFO UPLOAD_PROGRESS Skipped chunk 150 size 2868496, 89.09MB/s 00:00:07 56.6%
2019-06-08 08:16:54.864 INFO UPLOAD_PROGRESS Skipped chunk 151 size 7415443, 89.87MB/s 00:00:07 57.1%
2019-06-08 08:16:54.874 INFO UPLOAD_PROGRESS Skipped chunk 152 size 1421136, 90.02MB/s 00:00:07 57.1%
2019-06-08 08:16:54.890 INFO UPLOAD_PROGRESS Skipped chunk 153 size 2037940, 90.24MB/s 00:00:07 57.3%
2019-06-08 08:16:54.903 INFO UPLOAD_PROGRESS Skipped chunk 154 size 1355864, 90.38MB/s 00:00:07 57.4%
2019-06-08 08:16:54.994 INFO UPLOAD_PROGRESS Skipped chunk 155 size 8677765, 91.30MB/s 00:00:07 58.0%
2019-06-08 08:16:55.038 INFO UPLOAD_PROGRESS Skipped chunk 156 size 4367873, 82.59MB/s 00:00:08 58.3%
2019-06-08 08:16:55.050 INFO UPLOAD_PROGRESS Skipped chunk 157 size 1552296, 82.74MB/s 00:00:08 58.4%
2019-06-08 08:16:55.105 INFO UPLOAD_PROGRESS Skipped chunk 158 size 5273901, 83.24MB/s 00:00:08 58.7%
2019-06-08 08:16:55.137 INFO UPLOAD_PROGRESS Skipped chunk 159 size 3422321, 83.57MB/s 00:00:07 58.9%
2019-06-08 08:16:55.163 INFO UPLOAD_PROGRESS Skipped chunk 160 size 2831349, 83.84MB/s 00:00:07 59.1%
2019-06-08 08:16:55.203 INFO UPLOAD_PROGRESS Skipped chunk 161 size 4086283, 84.23MB/s 00:00:07 59.4%
2019-06-08 08:16:55.251 INFO UPLOAD_PROGRESS Skipped chunk 162 size 4624622, 84.67MB/s 00:00:07 59.7%
2019-06-08 08:16:55.307 INFO UPLOAD_PROGRESS Skipped chunk 163 size 4837322, 85.13MB/s 00:00:07 60.0%
2019-06-08 08:16:55.367 INFO UPLOAD_PROGRESS Skipped chunk 164 size 5791448, 85.68MB/s 00:00:07 60.4%
2019-06-08 08:16:55.519 INFO UPLOAD_PROGRESS Skipped chunk 165 size 13423208, 86.96MB/s 00:00:07 61.3%
2019-06-08 08:16:55.541 INFO UPLOAD_PROGRESS Skipped chunk 166 size 2222675, 87.17MB/s 00:00:07 61.5%
2019-06-08 08:16:55.670 INFO UPLOAD_PROGRESS Skipped chunk 167 size 8284726, 87.96MB/s 00:00:07 62.0%
2019-06-08 08:16:55.785 INFO UPLOAD_PROGRESS Skipped chunk 168 size 7934084, 88.72MB/s 00:00:06 62.6%
2019-06-08 08:16:55.810 INFO UPLOAD_PROGRESS Skipped chunk 169 size 2631018, 88.97MB/s 00:00:06 62.8%
2019-06-08 08:16:55.865 INFO UPLOAD_PROGRESS Skipped chunk 170 size 5268530, 89.47MB/s 00:00:06 63.1%
2019-06-08 08:16:55.880 INFO UPLOAD_PROGRESS Skipped chunk 171 size 2049739, 89.67MB/s 00:00:06 63.3%
2019-06-08 08:16:56.061 INFO UPLOAD_PROGRESS Skipped chunk 172 size 16777216, 82.97MB/s 00:00:07 64.4%
2019-06-08 08:16:56.176 INFO UPLOAD_PROGRESS Skipped chunk 173 size 10577352, 83.89MB/s 00:00:06 65.1%
2019-06-08 08:16:56.188 INFO UPLOAD_PROGRESS Skipped chunk 174 size 1650816, 84.03MB/s 00:00:06 65.2%
2019-06-08 08:16:56.246 INFO UPLOAD_PROGRESS Skipped chunk 175 size 3171821, 84.31MB/s 00:00:06 65.4%
2019-06-08 08:16:56.302 INFO UPLOAD_PROGRESS Skipped chunk 176 size 5481194, 84.78MB/s 00:00:06 65.8%
2019-06-08 08:16:56.327 INFO UPLOAD_PROGRESS Skipped chunk 177 size 2781418, 85.02MB/s 00:00:06 66.0%
2019-06-08 08:16:56.366 INFO UPLOAD_PROGRESS Skipped chunk 178 size 3997260, 85.37MB/s 00:00:06 66.2%
2019-06-08 08:16:56.378 INFO UPLOAD_PROGRESS Skipped chunk 179 size 1431248, 85.49MB/s 00:00:06 66.3%
2019-06-08 08:16:56.409 INFO UPLOAD_PROGRESS Skipped chunk 180 size 3210977, 85.77MB/s 00:00:06 66.6%
2019-06-08 08:16:56.437 INFO UPLOAD_PROGRESS Skipped chunk 181 size 3143514, 86.05MB/s 00:00:06 66.8%
2019-06-08 08:16:56.458 INFO UPLOAD_PROGRESS Skipped chunk 182 size 2138841, 86.23MB/s 00:00:06 66.9%
2019-06-08 08:16:56.470 INFO UPLOAD_PROGRESS Skipped chunk 183 size 1675198, 86.38MB/s 00:00:06 67.0%
2019-06-08 08:16:56.498 INFO UPLOAD_PROGRESS Skipped chunk 184 size 2911403, 86.63MB/s 00:00:06 67.2%
2019-06-08 08:16:56.521 INFO UPLOAD_PROGRESS Skipped chunk 185 size 2354939, 86.83MB/s 00:00:06 67.4%
2019-06-08 08:16:56.535 INFO UPLOAD_PROGRESS Skipped chunk 186 size 1811450, 86.99MB/s 00:00:06 67.5%
2019-06-08 08:16:56.665 INFO UPLOAD_PROGRESS Skipped chunk 187 size 10461642, 87.90MB/s 00:00:06 68.2%
2019-06-08 08:16:56.687 INFO UPLOAD_PROGRESS Skipped chunk 188 size 2125239, 88.08MB/s 00:00:06 68.3%
2019-06-08 08:16:56.801 INFO UPLOAD_PROGRESS Skipped chunk 189 size 10702826, 89.01MB/s 00:00:05 69.1%
2019-06-08 08:16:56.850 INFO UPLOAD_PROGRESS Skipped chunk 190 size 2780954, 89.25MB/s 00:00:05 69.3%
2019-06-08 08:16:56.889 INFO UPLOAD_PROGRESS Skipped chunk 191 size 3528046, 89.56MB/s 00:00:05 69.5%
2019-06-08 08:16:57.054 INFO UPLOAD_PROGRESS Skipped chunk 192 size 12413177, 83.08MB/s 00:00:06 70.3%
2019-06-08 08:16:57.102 INFO UPLOAD_PROGRESS Skipped chunk 193 size 4645671, 83.45MB/s 00:00:05 70.6%
2019-06-08 08:16:57.122 INFO UPLOAD_PROGRESS Skipped chunk 194 size 2113678, 83.62MB/s 00:00:05 70.8%
2019-06-08 08:16:57.170 INFO UPLOAD_PROGRESS Skipped chunk 195 size 4947287, 84.01MB/s 00:00:05 71.1%
2019-06-08 08:16:57.212 INFO UPLOAD_PROGRESS Skipped chunk 196 size 4160325, 84.34MB/s 00:00:05 71.4%
2019-06-08 08:16:57.241 INFO UPLOAD_PROGRESS Skipped chunk 197 size 2697384, 84.55MB/s 00:00:05 71.6%
2019-06-08 08:16:57.298 INFO UPLOAD_PROGRESS Skipped chunk 198 size 5542328, 84.99MB/s 00:00:05 72.0%
2019-06-08 08:16:57.346 INFO UPLOAD_PROGRESS Skipped chunk 199 size 4635131, 85.36MB/s 00:00:05 72.3%
2019-06-08 08:16:57.449 INFO UPLOAD_PROGRESS Skipped chunk 200 size 9551765, 86.12MB/s 00:00:05 72.9%
2019-06-08 08:16:57.509 INFO UPLOAD_PROGRESS Skipped chunk 201 size 5965195, 86.60MB/s 00:00:05 73.3%
2019-06-08 08:16:57.535 INFO UPLOAD_PROGRESS Skipped chunk 202 size 2783866, 86.82MB/s 00:00:05 73.5%
2019-06-08 08:16:57.650 INFO UPLOAD_PROGRESS Skipped chunk 203 size 10652060, 87.66MB/s 00:00:05 74.2%
2019-06-08 08:16:57.660 INFO UPLOAD_PROGRESS Skipped chunk 204 size 1453635, 87.78MB/s 00:00:05 74.3%
2019-06-08 08:16:57.723 INFO UPLOAD_PROGRESS Skipped chunk 205 size 6164515, 88.27MB/s 00:00:05 74.7%
2019-06-08 08:16:57.827 INFO UPLOAD_PROGRESS Skipped chunk 206 size 9625130, 89.03MB/s 00:00:04 75.4%
2019-06-08 08:16:57.885 INFO UPLOAD_PROGRESS Skipped chunk 207 size 5745941, 89.49MB/s 00:00:04 75.8%
2019-06-08 08:16:57.969 INFO UPLOAD_PROGRESS Skipped chunk 208 size 8080872, 90.13MB/s 00:00:04 76.3%
2019-06-08 08:16:58.027 INFO UPLOAD_PROGRESS Skipped chunk 209 size 5533756, 83.61MB/s 00:00:04 76.7%
2019-06-08 08:16:58.042 INFO UPLOAD_PROGRESS Skipped chunk 210 size 2054431, 83.76MB/s 00:00:04 76.8%
2019-06-08 08:16:58.061 INFO UPLOAD_PROGRESS Skipped chunk 211 size 2083675, 83.91MB/s 00:00:04 77.0%
2019-06-08 08:16:58.072 INFO UPLOAD_PROGRESS Skipped chunk 212 size 1236134, 84.00MB/s 00:00:04 77.0%
2019-06-08 08:16:58.108 INFO UPLOAD_PROGRESS Skipped chunk 213 size 3760509, 84.28MB/s 00:00:04 77.3%
2019-06-08 08:16:58.117 INFO UPLOAD_PROGRESS Skipped chunk 214 size 1186237, 84.36MB/s 00:00:04 77.4%
2019-06-08 08:16:58.128 INFO UPLOAD_PROGRESS Skipped chunk 215 size 1496774, 84.47MB/s 00:00:04 77.5%
2019-06-08 08:16:58.166 INFO UPLOAD_PROGRESS Skipped chunk 216 size 3908152, 84.76MB/s 00:00:04 77.7%
2019-06-08 08:16:58.180 INFO UPLOAD_PROGRESS Skipped chunk 217 size 1590486, 84.88MB/s 00:00:04 77.8%
2019-06-08 08:16:58.204 INFO UPLOAD_PROGRESS Skipped chunk 218 size 2505957, 85.06MB/s 00:00:04 78.0%
2019-06-08 08:16:58.334 INFO UPLOAD_PROGRESS Skipped chunk 219 size 12054821, 85.94MB/s 00:00:04 78.8%
2019-06-08 08:16:58.449 INFO UPLOAD_PROGRESS Skipped chunk 220 size 10719734, 86.73MB/s 00:00:04 79.5%
2019-06-08 08:16:58.459 INFO UPLOAD_PROGRESS Skipped chunk 221 size 1448651, 86.84MB/s 00:00:04 79.6%
2019-06-08 08:16:58.541 INFO UPLOAD_PROGRESS Skipped chunk 222 size 7858591, 87.41MB/s 00:00:04 80.2%
2019-06-08 08:16:58.609 INFO UPLOAD_PROGRESS Skipped chunk 223 size 6487107, 87.89MB/s 00:00:04 80.6%
2019-06-08 08:16:58.736 INFO UPLOAD_PROGRESS Skipped chunk 224 size 12030936, 88.77MB/s 00:00:03 81.4%
2019-06-08 08:16:58.748 INFO UPLOAD_PROGRESS Skipped chunk 225 size 1495740, 88.88MB/s 00:00:03 81.5%
2019-06-08 08:16:58.762 INFO UPLOAD_PROGRESS Skipped chunk 226 size 1771044, 89.01MB/s 00:00:03 81.6%
2019-06-08 08:16:58.791 INFO UPLOAD_PROGRESS Skipped chunk 227 size 3102271, 89.24MB/s 00:00:03 81.8%
2019-06-08 08:16:58.809 INFO UPLOAD_PROGRESS Skipped chunk 228 size 2095717, 89.39MB/s 00:00:03 82.0%
2019-06-08 08:16:58.928 INFO UPLOAD_PROGRESS Skipped chunk 229 size 10361634, 90.15MB/s 00:00:03 82.7%
2019-06-08 08:16:58.978 INFO UPLOAD_PROGRESS Skipped chunk 230 size 4850330, 90.51MB/s 00:00:03 83.0%
2019-06-08 08:16:58.994 INFO UPLOAD_PROGRESS Skipped chunk 231 size 1907908, 90.65MB/s 00:00:03 83.1%
2019-06-08 08:16:59.096 INFO UPLOAD_PROGRESS Skipped chunk 232 size 9478807, 84.82MB/s 00:00:03 83.8%
2019-06-08 08:16:59.204 INFO UPLOAD_PROGRESS Skipped chunk 233 size 10458241, 85.53MB/s 00:00:03 84.5%
2019-06-08 08:16:59.252 INFO UPLOAD_PROGRESS Skipped chunk 234 size 4588217, 85.84MB/s 00:00:03 84.8%
2019-06-08 08:16:59.309 INFO UPLOAD_PROGRESS Skipped chunk 235 size 5438960, 86.22MB/s 00:00:03 85.2%
2019-06-08 08:16:59.324 INFO UPLOAD_PROGRESS Skipped chunk 236 size 1996201, 86.35MB/s 00:00:03 85.3%
2019-06-08 08:16:59.352 INFO UPLOAD_PROGRESS Skipped chunk 237 size 2784137, 86.54MB/s 00:00:03 85.5%
2019-06-08 08:16:59.397 INFO UPLOAD_PROGRESS Skipped chunk 238 size 4293762, 86.83MB/s 00:00:03 85.8%
2019-06-08 08:16:59.432 INFO UPLOAD_PROGRESS Skipped chunk 239 size 3595843, 87.08MB/s 00:00:03 86.0%
2019-06-08 08:16:59.454 INFO UPLOAD_PROGRESS Skipped chunk 240 size 2439225, 87.24MB/s 00:00:03 86.2%
2019-06-08 08:16:59.617 INFO UPLOAD_PROGRESS Skipped chunk 241 size 14317496, 88.22MB/s 00:00:03 87.1%
2019-06-08 08:16:59.664 INFO UPLOAD_PROGRESS Skipped chunk 242 size 2955523, 88.42MB/s 00:00:03 87.3%
2019-06-08 08:16:59.735 INFO UPLOAD_PROGRESS Skipped chunk 243 size 5898265, 88.82MB/s 00:00:02 87.7%
2019-06-08 08:16:59.802 INFO UPLOAD_PROGRESS Skipped chunk 244 size 4629308, 89.14MB/s 00:00:02 88.0%
2019-06-08 08:16:59.971 INFO UPLOAD_PROGRESS Skipped chunk 245 size 15668438, 90.21MB/s 00:00:02 89.1%
2019-06-08 08:16:59.986 INFO UPLOAD_PROGRESS Skipped chunk 246 size 1638037, 90.32MB/s 00:00:02 89.2%
2019-06-08 08:17:00.059 INFO UPLOAD_PROGRESS Skipped chunk 247 size 7177103, 84.75MB/s 00:00:02 89.7%
2019-06-08 08:17:00.086 INFO UPLOAD_PROGRESS Skipped chunk 248 size 2467751, 84.91MB/s 00:00:02 89.9%
2019-06-08 08:17:00.121 INFO UPLOAD_PROGRESS Skipped chunk 249 size 3570791, 85.14MB/s 00:00:02 90.1%
2019-06-08 08:17:00.158 INFO UPLOAD_PROGRESS Skipped chunk 250 size 3676684, 85.37MB/s 00:00:02 90.3%
2019-06-08 08:17:00.183 INFO UPLOAD_PROGRESS Skipped chunk 251 size 2748597, 85.54MB/s 00:00:02 90.5%
2019-06-08 08:17:00.217 INFO UPLOAD_PROGRESS Skipped chunk 252 size 3228592, 85.75MB/s 00:00:02 90.8%
2019-06-08 08:17:00.252 INFO UPLOAD_PROGRESS Skipped chunk 253 size 3614178, 85.98MB/s 00:00:02 91.0%
2019-06-08 08:17:00.320 INFO UPLOAD_PROGRESS Skipped chunk 254 size 6477043, 86.39MB/s 00:00:02 91.4%
2019-06-08 08:17:00.499 INFO UPLOAD_PROGRESS Skipped chunk 255 size 16777216, 87.46MB/s 00:00:02 92.6%
2019-06-08 08:17:00.680 INFO UPLOAD_PROGRESS Skipped chunk 256 size 16777216, 88.52MB/s 00:00:02 93.7%
2019-06-08 08:17:00.861 INFO UPLOAD_PROGRESS Skipped chunk 257 size 16777216, 89.59MB/s 00:00:01 94.8%
2019-06-08 08:17:01.042 INFO UPLOAD_PROGRESS Skipped chunk 258 size 16777216, 84.99MB/s 00:00:01 95.9%
2019-06-08 08:17:01.224 INFO UPLOAD_PROGRESS Skipped chunk 259 size 16777216, 85.99MB/s 00:00:01 97.1%
2019-06-08 08:17:01.408 INFO UPLOAD_PROGRESS Skipped chunk 260 size 16777216, 86.99MB/s 00:00:01 98.2%
2019-06-08 08:17:01.622 INFO UPLOAD_PROGRESS Skipped chunk 261 size 16777216, 87.99MB/s 00:00:01 99.3%
2019-06-08 08:17:01.711 INFO PACK_END Packed Chattel/Administration/Former Employee Backups/Chrisitine Mathieson/Email/Christine Email.pst (1485382656)
2019-06-08 08:17:01.720 INFO UPLOAD_PROGRESS Skipped chunk 262 size 9119421, 88.54MB/s 00:00:01 100.0%
2019-06-08 08:17:26.344 INFO BACKUP_END Backup for D:\ at revision 7549 completed
2019-06-08 08:17:26.344 INFO BACKUP_STATS Files: 763153 total, 1794G bytes; 1 new, 1,416M bytes
2019-06-08 08:17:26.344 INFO BACKUP_STATS File chunks: 380477 total, 1796G bytes; 1 new, 5,833K bytes, 2,619K bytes uploaded
2019-06-08 08:17:26.344 INFO BACKUP_STATS Metadata chunks: 49 total, 281,537K bytes; 2 new, 18,015K bytes, 9,656K bytes uploaded
2019-06-08 08:17:26.344 INFO BACKUP_STATS All chunks: 380526 total, 1796G bytes; 3 new, 23,849K bytes, 12,276K bytes uploaded
2019-06-08 08:17:26.344 INFO BACKUP_STATS Total running time: 00:14:52
2019-06-08 08:17:27.565 INFO VSS_DELETE The shadow copy has been successfully deleted
#10

The log for revision 7549 looks fine. I looked at your older logs and it looked like there had been some disk errors causing a lot files to be skipped and not included in the backup. When those files became accessible again Duplicacy thought they were new files (as it only looked at the last backup as the base for file comparison) and attempted to upload them again (during which most chunks are skipped and not actually uploaded).

#11

So this is not a bug?

#12

one would think it would be… essentially the whole backup was completed long before in revision 1… when they disk began to fail it started going back and trying to upload stuff from 2010 instead of the recently changed files which in turn caused the end user to lose a month or so worth of data

#13

No, Duplicacy won’t reupload all files if the previous backup contains few files – it will only scan all files and then figure out most chunks have been uploaded before. In any case there won’t be any data loss because old backups aren’t affected and new backups created when the disk works properly are correct and complete.

#14

well what would happen is it would start its hourly job and it would run for for the whole hour and then around 50 some mins would stop … the next job would start and upload one pst file that someone had open… it would do this over and over again… then as soon as the files changed the next day it would then start the backup over again and after 50 some odd mins it would stop…

i cant put my hands on it in the logs… and i cannot recreate the issue…

i can upload all the logs to some ftp server if you want to scour them… what i sent was just a sample

#15

also every one of the large logs show about 300 mb or gb… i cant remember uploaded… but going through the logs all the files have timestamps of back in 2010

#16

What is the issue here? The problem seems to be a failing hard drive… stopping the backup job from completing. If it’s physically preventing Duplicacy from working properly, how is that a bug in Duplicacy?

A failing hard drive can exhibit 101 different symptoms and software can only do so much to work through it, but it can’t perform miracles. Hardware fails, and when it does it should be fixed/replaced asap.

2 Likes
#17

To elaborate on @Droolio’s comment, there are also data corruption failure modes that could be making the files on disk actually new files if parts of them are being zeroed out/changed to garbage. :d: has no way to know that the data is bad and it’ll happily upload bad data and may even eventually prune good data.

In computer science, we have the term “garbage in, garbage out” which essentially means that if bad data goes into a system, bad data comes out.

1 Like