Duplicacy check -> out of memory

(congrats for the new forum!)

 duplicacy check -all
Storage set to sftp://xxx
Listing all chunks
All chunks referenced by snapshot xxx at revision 1 exist
All chunks referenced by snapshot xxx at revision 2 exist
[...]
All chunks referenced by snapshot xxx at revision 60 exist
All chunks referenced by snapshot xxx at revision 61 exist
All chunks referenced by snapshot xxx at revision 62 exist
fatal error: out of memory

runtime stack:
runtime.throw(0x806431, 0xd)
        /usr/local/go/src/runtime/panic.go:596 +0x70
runtime.(*mcache).refill(0x75f5e258, 0x17, 0x60ead0c0)
        /usr/local/go/src/runtime/mcache.go:124 +0xf0
runtime.(*mcache).nextFree.func1()
        /usr/local/go/src/runtime/malloc.go:526 +0x24
runtime.systemstack(0x10f18000)
        /usr/local/go/src/runtime/asm_arm.s:264 +0x80
runtime.mstart()
        /usr/local/go/src/runtime/proc.go:1132

goroutine 1 [running]:
runtime.systemstack_switch()
        /usr/local/go/src/runtime/asm_arm.s:209 +0x4 fp=0x13cf252c sp=0x13cf2528
runtime.(*mcache).nextFree(0x75f5e258, 0x17, 0x5a98c, 0x60ead0c0, 0x40)
        /usr/local/go/src/runtime/malloc.go:527 +0x9c fp=0x13cf2558 sp=0x13cf252                                                                                                                                                             c
runtime.mallocgc(0x1c0, 0x7c8b60, 0x5a401, 0x40)
        /usr/local/go/src/runtime/malloc.go:679 +0x8c0 fp=0x13cf25b4 sp=0x13cf25                                                                                                                                                             58
runtime.newobject(0x7c8b60, 0x0)
        /usr/local/go/src/runtime/malloc.go:808 +0x2c fp=0x13cf25c8 sp=0x13cf25b                                                                                                                                                             4
github.com/gilbertchen/duplicacy/vendor/github.com/minio/blake2b-simd.New(0x13cf                                                                                                                                                             2618, 0x60ead0c0, 0x5a3e8, 0x60ead0c0, 0x138188)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/git                                                                                                                                                             hub.com/minio/blake2b-simd/blake2b.go:117 +0x5c fp=0x13cf25dc sp=0x13cf25c8
github.com/gilbertchen/duplicacy/src.(*Config).NewKeyedHasher(0x10fc2360, 0x10fc                                                                                                                                                             0460, 0x20, 0x20, 0x6021ed10, 0x60ead0c0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/src/duplic                                                                                                                                                             acy_config.go:238 +0x60 fp=0x13cf2644 sp=0x13cf25dc
github.com/gilbertchen/duplicacy/src.(*Config).GetChunkIDFromHash(0x10fc2360, 0x                                                                                                                                                             3d3b6860, 0x20, 0x60ead0c0, 0x40)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/src/duplic                                                                                                                                                             acy_config.go:314 +0x34 fp=0x13cf266c sp=0x13cf2644
github.com/gilbertchen/duplicacy/src.(*SnapshotManager).GetSnapshotChunks(0x10fc                                                                                                                                                             05e0, 0x31f60cf0, 0x0, 0x13cf28f0, 0x13cf2a14)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/src/duplic                                                                                                                                                             acy_snapshotmanager.go:628 +0x3e4 fp=0x13cf26d4 sp=0x13cf266c
github.com/gilbertchen/duplicacy/src.(*SnapshotManager).CheckSnapshots(0x10fc05e                                                                                                                                                             0, 0x10fd6120, 0x8, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/src/duplic                                                                                                                                                             acy_snapshotmanager.go:809 +0x7ec fp=0x13cf2c60 sp=0x13cf26d4
main.checkSnapshots(0x10fc98c0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/duplicacy/                                                                                                                                                             duplicacy_main.go:890 +0x3d4 fp=0x13cf2d00 sp=0x13cf2c60
github.com/gilbertchen/duplicacy/vendor/github.com/gilbertchen/cli.Command.Run(0                                                                                                                                                             x7fd830, 0x5, 0x0, 0x0, 0x0, 0x0, 0x0, 0x818fc8, 0x20, 0x0, ...)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/git                                                                                                                                                             hub.com/gilbertchen/cli/command.go:160 +0x614 fp=0x13cf2eac sp=0x13cf2d00
github.com/gilbertchen/duplicacy/vendor/github.com/gilbertchen/cli.(*App).Run(0x                                                                                                                                                             1100cf00, 0x10f0e280, 0x3, 0x4, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/git                                                                                                                                                             hub.com/gilbertchen/cli/app.go:179 +0x5e4 fp=0x13cf3134 sp=0x13cf2eac
main.main()
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/duplicacy/                                                                                                                                                             duplicacy_main.go:1860 +0x3718 fp=0x13cf3fbc sp=0x13cf3134
runtime.main()
        /usr/local/go/src/runtime/proc.go:185 +0x1e4 fp=0x13cf3fe4 sp=0x13cf3fbc
runtime.goexit()
        /usr/local/go/src/runtime/asm_arm.s:1017 +0x4 fp=0x13cf3fe4 sp=0x13cf3fe                                                                                                                                                             4

goroutine 5 [syscall, 131 minutes]:
os/signal.signal_recv(0x0)
        /usr/local/go/src/runtime/sigqueue.go:116 +0x154
os/signal.loop()
        /usr/local/go/src/os/signal/signal_unix.go:22 +0x14
created by os/signal.init.1
        /usr/local/go/src/os/signal/signal_unix.go:28 +0x30

goroutine 20 [IO wait, 4 minutes]:
net.runtime_pollWait(0x75f02f70, 0x72, 0x110f4000)
        /usr/local/go/src/runtime/netpoll.go:164 +0x44
net.(*pollDesc).wait(0x110b4fbc, 0x72, 0xc42b70, 0xc40164)
        /usr/local/go/src/net/fd_poll_runtime.go:75 +0x28
net.(*pollDesc).waitRead(0x110b4fbc, 0x110f4000, 0x1000)
        /usr/local/go/src/net/fd_poll_runtime.go:80 +0x24
net.(*netFD).Read(0x110b4f80, 0x110f4000, 0x1000, 0x1000, 0x0, 0xc42b70, 0xc4016                                                                                                                                                             4)
        /usr/local/go/src/net/fd_unix.go:250 +0x148
net.(*conn).Read(0x10fcce48, 0x110f4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/local/go/src/net/net.go:181 +0x58
bufio.(*Reader).Read(0x11018810, 0x110aca31, 0x5, 0x5, 0x862bbf36, 0x123748af, 0                                                                                                                                                             x5057cf59)
        /usr/local/go/src/bufio/bufio.go:213 +0x280
io.ReadAtLeast(0xc40e90, 0x11018810, 0x110aca31, 0x5, 0x5, 0x5, 0x0, 0x1, 0x0)
        /usr/local/go/src/io/io.go:307 +0x8c
io.ReadFull(0xc40e90, 0x11018810, 0x110aca31, 0x5, 0x5, 0x10f22500, 0x75f5e258,                                                                                                                                                              0x0)
        /usr/local/go/src/io/io.go:325 +0x40
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*streamPacketCi                                                                                                                                                             pher).readPacket(0x110aca20, 0x1c04, 0xc40e90, 0x11018810, 0x110b51f0, 0x1, 0x0,                                                                                                                                                              0x14a01, 0x1)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/cipher.go:150 +0x48
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*connectionStat                                                                                                                                                             e).readPacket(0x10fc9b90, 0x11018810, 0x10f1bf8c, 0x25, 0x25, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/transport.go:129 +0x40
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*transport).rea                                                                                                                                                             dPacket(0x10fc9b90, 0x124b40f0, 0x25, 0x25, 0x0, 0x110b51f0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/transport.go:113 +0x24
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*handshakeTrans                                                                                                                                                             port).readOnePacket(0x10fd9800, 0x110b5100, 0x10f1bfd8, 0x25, 0x25, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/handshake.go:374 +0x28
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*handshakeTrans                                                                                                                                                             port).readLoop(0x10fd9800)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/handshake.go:197 +0x24
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.newCl                                                                                                                                                             ientTransport
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/handshake.go:134 +0x138

goroutine 18 [select, 131 minutes, locked to thread]:
runtime.gopark(0x836534, 0x0, 0x7ff0d9, 0x6, 0x18, 0x2)
        /usr/local/go/src/runtime/proc.go:271 +0xfc
runtime.selectgoImpl(0x10f1afa0, 0x0, 0xc)
        /usr/local/go/src/runtime/select.go:423 +0x116c
runtime.selectgo(0x10f1afa0)
        /usr/local/go/src/runtime/select.go:238 +0x10
runtime.ensureSigM.func1()
        /usr/local/go/src/runtime/signal_unix.go:434 +0x2bc
runtime.goexit()
        /usr/local/go/src/runtime/asm_arm.s:1017 +0x4

goroutine 19 [chan receive, 131 minutes]:
main.main.func1(0x110b4d00)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/duplicacy/                                                                                                                                                             duplicacy_main.go:1854 +0x38
created by main.main
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/duplicacy/                                                                                                                                                             duplicacy_main.go:1858 +0x36e8

goroutine 21 [select, 131 minutes]:
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*handshakeTrans                                                                                                                                                             port).kexLoop(0x10fd9800)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/handshake.go:268 +0x768
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.newCl                                                                                                                                                             ientTransport
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/handshake.go:135 +0x154

goroutine 10 [chan receive, 4 minutes]:
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*handshakeTrans                                                                                                                                                             port).readPacket(0x10fd9800, 0x124b40f0, 0x25, 0x25, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/handshake.go:187 +0x44
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*mux).onePacket                                                                                                                                                             (0x10f17180, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/mux.go:215 +0x28
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*mux).loop(0x10                                                                                                                                                             f17180)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/mux.go:190 +0x34
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.newMu                                                                                                                                                             x
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/mux.go:128 +0x18c

goroutine 11 [chan receive, 131 minutes]:
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*Client).handle                                                                                                                                                             GlobalRequests(0x10f105d0, 0x10f17100)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/client.go:138 +0x34
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.NewCl                                                                                                                                                             ient
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/client.go:57 +0xbc

goroutine 12 [chan receive, 131 minutes]:
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*Client).handle                                                                                                                                                             ChannelOpens(0x10f105d0, 0x10f17080)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/client.go:147 +0x38
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.NewCl                                                                                                                                                             ient
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/client.go:58 +0xe0

goroutine 13 [semacquire, 131 minutes]:
sync.runtime_notifyListWait(0x10f0f888, 0x0)
        /usr/local/go/src/runtime/sema.go:298 +0x138
sync.(*Cond).Wait(0x10f0f880)
        /usr/local/go/src/sync/cond.go:57 +0x78
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*mux).Wait(0x10                                                                                                                                                             f17180, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/mux.go:110 +0x8c
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.NewClient.func1(                                                                                                                                                             0x10f105d0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/client.go:60 +0x28
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.NewCl                                                                                                                                                             ient
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/client.go:62 +0xfc

goroutine 14 [chan receive, 131 minutes]:
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*forwardList).h                                                                                                                                                             andleChannels(0x10f105d8, 0x10f171c0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/tcpip.go:186 +0x38
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.NewCl                                                                                                                                                             ient
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/client.go:63 +0x144

goroutine 15 [chan receive, 131 minutes]:
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*forwardList).h                                                                                                                                                             andleChannels(0x10f105d8, 0x10f17200)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/tcpip.go:186 +0x38
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.NewCl                                                                                                                                                             ient
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/client.go:64 +0x184

goroutine 16 [chan receive, 131 minutes]:
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*Session).wait(                                                                                                                                                             0x10f783c0, 0x10f17240, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/session.go:423 +0x48
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.newSession.func1                                                                                                                                                             (0x10f783c0, 0x10f17240)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/session.go:593 +0x24
created by github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.newSe                                                                                                                                                             ssion
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/session.go:594 +0xa8

goroutine 33 [semacquire, 4 minutes]:
sync.runtime_notifyListWait(0x10f0f8e8, 0x152d)
        /usr/local/go/src/runtime/sema.go:298 +0x138
sync.(*Cond).Wait(0x10f0f8e0)
        /usr/local/go/src/sync/cond.go:57 +0x78
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*buffer).Read(0                                                                                                                                                             x10f8fd40, 0x10f8f9c8, 0x4, 0x4, 0x0, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/buffer.go:94 +0x124
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*channel).ReadE                                                                                                                                                             xtended(0x10f5c680, 0x10f8f9c8, 0x4, 0x4, 0x0, 0x18, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/channel.go:351 +0x1a8
github.com/gilbertchen/duplicacy/vendor/golang.org/x/crypto/ssh.(*channel).Read(                                                                                                                                                             0x10f5c680, 0x10f8f9c8, 0x4, 0x4, 0x18, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/gol                                                                                                                                                             ang.org/x/crypto/ssh/channel.go:528 +0x48
github.com/gilbertchen/duplicacy/vendor/github.com/pkg/sftp.(*conn).Read(0x110b5                                                                                                                                                             e40, 0x10f8f9c8, 0x4, 0x4, 0x1d6f0, 0x1fac3930, 0x0)
        <autogenerated>:1 +0x64
io.ReadAtLeast(0xc41400, 0x110b5e40, 0x10f8f9c8, 0x4, 0x4, 0x4, 0x6fe518, 0x1, 0                                                                                                                                                             x10f8f9c8)
        /usr/local/go/src/io/io.go:307 +0x8c
io.ReadFull(0xc41400, 0x110b5e40, 0x10f8f9c8, 0x4, 0x4, 0x18, 0x0, 0x0)
        /usr/local/go/src/io/io.go:325 +0x40
github.com/gilbertchen/duplicacy/vendor/github.com/pkg/sftp.recvPacket(0xc41400,                                                                                                                                                              0x110b5e40, 0x6f0fa8, 0x1fac3900, 0x10f3afbc, 0x1, 0x5ef924, 0x1)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/git                                                                                                                                                             hub.com/pkg/sftp/packet.go:143 +0x7c
github.com/gilbertchen/duplicacy/vendor/github.com/pkg/sftp.(*conn).recvPacket(0                                                                                                                                                             x110b5e40, 0x1fac3900, 0x10f3afbc, 0x110221f0, 0x1, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/git                                                                                                                                                             hub.com/pkg/sftp/conn.go:22 +0x24
github.com/gilbertchen/duplicacy/vendor/github.com/pkg/sftp.(*clientConn).recv(0                                                                                                                                                             x110b5e40, 0x0, 0x0)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/git                                                                                                                                                             hub.com/pkg/sftp/conn.go:64 +0x50
github.com/gilbertchen/duplicacy/vendor/github.com/pkg/sftp.(*clientConn).loop(0                                                                                                                                                             x110b5e40)
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/git                                                                                                                                                             hub.com/pkg/sftp/conn.go:49 +0x48
created by github.com/gilbertchen/duplicacy/vendor/github.com/pkg/sftp.NewClient                                                                                                                                                             Pipe
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/vendor/git                                                                                                                                                             hub.com/pkg/sftp/client.go:97 +0x1a8

goroutine 24 [select, 4 minutes]:
github.com/gilbertchen/duplicacy/src.CreateChunkDownloader.func1(0x12dcc240, 0x0                                                                                                                                                             )
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/src/duplic                                                                                                                                                             acy_chunkdownloader.go:80 +0x114
created by github.com/gilbertchen/duplicacy/src.CreateChunkDownloader
        /Users/chgang/zincbox/go/src/github.com/gilbertchen/duplicacy/src/duplic                                                                                                                                                             acy_chunkdownloader.go:87 +0x240

I check my backups on a weekly bases. How can I make sure that it does not runs out of memory?
System is a QNAP NAS with 1GB Ram.

2018-07-27%2016_34_49

you can clearly see when the check started an ended :wink:

Try advice here to reduce memory usage by about 40% but with a number of files in the hundreds of thousands 1GB total system memory will likely be insufficient.

You can work around this by creating smaller backup sets and backing them up sequentially. The easiest would be to create a separate repos in several folders containing collections of symlinks to actual data [folders], to more or less evenly spread files by repos pointing to the same storage destination. Duplicacy follows first level symlinks.

How many files are there in your backup set?

2 Likes

It looks like the option solved it. I will run some more tests to confirm it.
I have 140918 files in my backup

For anyone: Feel free to use the :heart: button on posts that you found useful.

For the OP of any support topic: you can mark the post that solved your issue by ticking the :ballot_box_with_check: box under the post. :slight_smile: