Huge Amount of Chunks Missing

[GoldCoin]

Unfortunately, I just realized that my check job has been reporting missing chunks for a couple of days now. My environment is UnRaid and backing up to BackBlaze using the GUI.

When I ran check -persist the log shows more than a 2000 lines of missing chunks. I am not sure what happened and why so many chunks are missing. From what I could gather in the forum, it could be the pruning causing this which many users reported as a bug in 2022 (I think).

I found some posts in the forum suggesting some workarounds or solutions, but I didn’t see one for so many chunks. Most suggestions were to delete the chunks.

Has anyone used a script to remove this amount of chunks from storage? I found this solution, but the script is not running on my environment.

Prune does not delete snapshots

This was a great advice, and I was able to resolve the problems with my storage. I wrote a note for my future self, which I like to share here; let me know if you think something is not correctly represented. I hope this can be useful to other people: 1. Web resources Forum discussion: link about the problem described in this note. Fix missing chunks: this note assumes that we are able to recover the missing chunks. Sometimes however we do not want to recover them because they correctly were…

Not sure it is worth mentioning, that 99.5% of the missing chunks came from the same revision. See part of the log below:

2025-01-07 10:49:37.581 WARN SNAPSHOT_VALIDATE Chunk fd79adc533f0cd1ea6d65a37c1c0e596ac7671ff23e2238e1b0a7226f89e8fc8 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.608 WARN SNAPSHOT_VALIDATE Chunk 855a92216912cf979f73646cfe33dce0edaa738e1269ccff54b74c8de302da20 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.634 WARN SNAPSHOT_VALIDATE Chunk 193818d7578a3d09c0f3a5d44bfb0e373d4df364029ca9d3f0b064f436b741db referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.665 WARN SNAPSHOT_VALIDATE Chunk 3bb53d6898d17c33e2e3793be798d512fb0fc3c5b9658153f416d915d0135c4f referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.691 WARN SNAPSHOT_VALIDATE Chunk d209795ef2e93e62db6875d90bf05088505bd812851407b69d8bb1fd6a7d7fa5 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.721 WARN SNAPSHOT_VALIDATE Chunk e09d6faaf378ae5b0b9a007f87e0fe8f25bad165a4912da5a4a64eef2f09ef27 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.751 WARN SNAPSHOT_VALIDATE Chunk 0d16da925a055004e2856624d904bb2e017160fee24e920b216c9ca7532a88b4 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.779 WARN SNAPSHOT_VALIDATE Chunk 0b95b8adfcca9bacc323401eabfa4ef2c7d530b21314b3662a4ba5030382c164 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.806 WARN SNAPSHOT_VALIDATE Chunk 9f40ca1379f81990cb246299b2c5aa7abc93ac8b7bae11e1c99f759ac0388217 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.835 WARN SNAPSHOT_VALIDATE Chunk 477ed2221292d07ca156da6af8654b2c61d99dc706c6684c6f4e9a918c0afdc8 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.863 WARN SNAPSHOT_VALIDATE Chunk 22f556a2b8e8f3edcb9ec7125d862eec498041bd9abe9cf7e4052461062d5cb4 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.891 WARN SNAPSHOT_VALIDATE Chunk 25946551d7d9750bcee3efa53e88c971226401b9d4c3c46ad544ef32d657d865 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.918 WARN SNAPSHOT_VALIDATE Chunk d990a740ebf67eca2ea7273d806824f7aaf91244df92cd6796e334ba1f7301e1 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.946 WARN SNAPSHOT_VALIDATE Chunk 637f274b0dbe37133a6bedd829d53d1cec70b40be20f7a4ac5ecdabed239b01d referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.972 WARN SNAPSHOT_VALIDATE Chunk 451f80f91800e9877cc80bd76a227f5362bd791b03fa2ced2d68c36485d5708f referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:37.999 WARN SNAPSHOT_VALIDATE Chunk f6a2ab97c717991b7437d35becf3066e20b98c06a54a0f54bf81722fcbb72306 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:38.026 WARN SNAPSHOT_VALIDATE Chunk 250b4aa27c486d8a2d7f93e6dce6657048708c7e280fda82bac660b602a5b9f9 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:38.053 WARN SNAPSHOT_VALIDATE Chunk 97e3a091fc0807081c2989f4ee4ffd3bd509237905db67e5ed97379385c09acf referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:38.079 WARN SNAPSHOT_VALIDATE Chunk 99593e99c3794deb5185f28c5c8b7636e8082759867d381e54141d61bd2f5588 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:38.107 WARN SNAPSHOT_VALIDATE Chunk a1dcb61e3ee2239da8433bed94bb3f1fa42a932e7ed788d5f97e813fb0bd45a5 referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:38.133 WARN SNAPSHOT_VALIDATE Chunk 430e26105ba1492770c7ca98b26ad70832af7a3e085c9cc81b7cec64062de1cd referenced by snapshot 1 at revision 13 does not exist
2025-01-07 10:49:38.160 WARN SNAPSHOT_VALIDATE Chunk 469666964359d52e217522f55b256db4b1bb96b00f664cff58afed00a74960b1 referenced by snapshot 1 at revision 13 does not exist

[saspus]

1. Run check -a -persist
2. Collect affected revisions from the logs (grep/sort/unique, or visually)
3. Delete affected revision files from the storage
4. Run prune -exhaustive -a.

You can script it, but this being a one time thing it’s faster to do it manually.

[a.alberti82]

The reason why I wrote the script is that I did not want to deal with 2000 lines individually. I do not remember now all the details; I only remember that I had to repeat the same operation hundreds of times. Luckily, that was a one-time off for me, but still did not want to spend hours typing the same command.

Did the solutions posted above by the other users worked for you? If you can do it without the script, even better.