Can't restore my broken external harddrive

I guess that is because you used a new repository id for your new local folder. After you enter the bucket name and B2 credentials, the next step is to select the repository id as shown in this screenshot:

The default one is a new id generated from the hostname, the username, and the local folder. For restore, you need to pick the old one from the dropdown list that you used for your previous backups.

2 Likes

Dear gchen – and TheBestPessimist

You guys must be the smartes folks on earth since you apparently have succeed in guiding me through this. Impressive! You have my respect.

I’m still not sure I understand (that’s a lie: I really don’t understand), but your guidance combined withe several times of trial and error seemed to be the way for me. At least it seems that the restoring is now running. Hurray!

If more or new problems occur, I hope you will forgive writing you again!

All the best to the both of you
Laurids

2 Likes

Dear both – and now I’m already back (grrrr – sorry)

I’ve got my new external harddrive and startede to restore the backuped version of the broken harddrive using all the knowledge you provided me. Duplicacy starts to restore, but stops after a short period of time and have apparantly only restored the folder hierarchy – not the files ind the many folders.

What I do:

  1. After creating a new job and succesfully have filled out Repository and Storage, I click “Restore”…
  2. I then chose the latest revision and clicks “List files
  3. I then highlight the revision containing my Photo-library (*.photoslibrary) and clicks “Restore
  4. After a little while Duplicacy stops – as if the restore its done. But when I go to my new harddrive, Duplicacy has in fact re-createde a photolibrary, but as mentioned above it apparantly only contains the folder hierarchy.

As stated earlier the complete backup is as large as 619.7 GB – Is that a problem?

Apparantly I can restore single files one by one – but hopefully it’s possible to restore the entire library as a whole? Otherwise I’ll never get to the end!?

Please help. Again!

Best wishes,
Laurids

I have restored (albeit with CLI) one revision containing 3.7 TB of data (music, pics, and others – no videos – no files larger than 1 GB) and it worked w/o a hitch. restore works.

Now let’s see what @gchen sais: how you should continue.

I wonder if there’s a log file that you can share with us -> i suppose it’s somewhere in appdata folder, where duplicacy is installed.

Arrrggg – you have a lot of faith in me (and for that I thank you) – but I have absolutely no idea where to find this log file; sorry!

No probs. Just wait for gchen to solve this one for us :wink:

:+1:t4: I’m very grateful

I believe the restore operation encountered an error when retrying to restore some files. If you didn’t see any error message (or an error log) then it might be a bug in the GUI version. Upgrading to 2.1.1 may help.

Another option is to run the CLI version to restore. Open a DOS window, find out where the GUI version is installed (either :\Program Files (x86)\Duplicacy or C:\Users\username\AppData\Local\Duplicacy), then you’ll see the CLI executable there (or you can download one from Releases · gilbertchen/duplicacy · GitHub). Then run the following commands:

cd path\to\repository
path\to\duplicacy\cli restore -r revision

Dear gchen

I updated to 2.1.1 as soon as TheBestPessimist recommended it. So it can’t be that, I guess.

About the CLI solution (which I fear is to complicated for me) I would appreciate if you would try and guide me through the proces on a Mac. I don’t run Windows.

Please!?

Regards,
Laurids

I never worked with GUI or B2, you never worked with CLI (command line interface) so this will be a little more technical because i may forget steps.

  1. download this into your new repository: https://github.com/gilbertchen/duplicacy/releases/download/v2.1.1/duplicacy_osx_x64_2.1.1 (in the same folder where the folder.duplicacy exists – probably where you wanted to make your new restore).
  2. rename that file to dup for easier usage (in finder)
  3. open a terminal (cmd+space -> terminal) and now you have to move to your repository. that means you have to type cd someFolderName then enter, then again, and so on. This you should google.
  4. when you reach your repository (where dup file we downloaded is), run ./dup list to see all your revisions (and check that everything was setup correctly)
    • if it asks you for some passwords, you should provide now
  5. take a note of the revision number you want to restore (eg. 66). This probably is the latest revision (same number as in gui)
  6. run ./dup -d -log restore -r revision_number_from_above -threads 4
  7. wait for the restore to begin
    • if at some point it gives an error that you should run with -overwrite and the backup stops => just press up once to have the same command from #6 and add at the end -overwrite (note the space between all the command parameters in all my examples)

You may be able to solve it by running Duplicacy as root. First close the existing instance by clicking the icon on the menu bar and selecting quit. Then open a terminal and enter sudo open /Applications/Duplicacy.app and enter your login password as prompted.

If this still doesn’t help, then follow @TheBestPessimist’s instructions. Running the CLI is the most reliable way to fix errors like these.

Dear @gchen and @TheBestPessimist

Thanks – once more. Ordinary day work and family stuff came in the way. But now I’m at the computer again.

– didn’t work, unfortunately.

I got to no. 4 succesfully, but when I in the Terminal reached the repository where the dup file was downloaded and renamed to – and then ran ./dup list, Terminal said -bash: ./dup: Permission denied. And I hadn’t been asked for any passwords since I opened duplicacy as root (as @gchen suggested).

Any new advice?

PS:

What does

means? And why 4?

It’s also in the GUI version together with Rate Limit:

50

I’ve tried to Google both Rate Limit and Threads, but I don’t quite understand what I find (sorry).

You just need to run chmod u+x ./dup to make the file executable.

Thanks. That helped!

But after a short while the proces in Terminal stoped with this:

2018-08-18 18:11:05.021 ERROR RESTORE_CHOWN Failed to change uid or gid: chown /Volumes/TOSHIBA EXT/Foto-bibliotek-restore-mappe/Fotos-bibliotek.photoslibrary/private/com.apple.photoanalysisd/GraphService/PhotosGraph/liveupdate-photosgraph.graphdb-wal: operation not permitted

I guess I’m followed by bad luck. Or what?

Run #6 in my details with sudo in front (you may need to use -overwrite):
either: sudo ./dup -d -log restore -r revision_number_from_above -threads 4
or sudo dup -d -log restore -r revision_number_from_above -threads 4

You should start by searching for your problem.
Most likely you will find the #how-to guides (there’s plenty).
In our particular case there is this one: Restore command details which explains that -threads sets the number of downloading threads to 4 – just a random number i chose to improve the speed without killing your internet.

I thank you so much once again @TheBestPessimist. I simply cannot express my appreciation enough – I’m very, very gratefull.

Finally it seems like a succesfull restoring of my photolibrary is in progress. So far 70 Gb of the 620 Gb has been restored. I have had to restart the process a few times after it have stopped; but now it seems like everything is on the right track.

I consulted your Restore command details – and thanks also for that.

I do, though, have to aknowledge that operations like this is WAY to difficult for me, and I should never have engaged in this duplicacy / back blaze business when crashplan stoped their personal version.

Especially when the GUI version doesn’t seem to work for me. I need WYSIWYG solutions. I’ll never be a “Terminal guy” comprehending written operations.

And believe me. I have used hours and hours on searching my problem before I finally tried to get help in this support forum. But as you yourself wrote, @TheBestPessimist, there’s plenty of online help and guides. But when you – as I – don’t know what your looking for, that’s not exactly a good thing.

I therefor need to find another backup solution for the family computers (in total 5) without paying a fortune, but in a way where a simple restore operation doesn’t have to take 2 weeks, and where I have to rely on the good will of fantastic helpful people like the two of you, @TheBestPessimist and @gchen.

I salute you – and hope I don’t have to disturb any of you again!

If the GUI version doesn’t work, it should be fixed. @gchen acknowledged at some point that

I didn’t follow the discussion close enough to say whether this was confirmed, but if it was, I’d like to say that duplicacy is a very (!) young backup solution and it is common and virtually unavoidable that new software like this will have some bugs here and there. Whether you’re willing to give duplicacy anothrr try or go on looking for something else, I therefore suggest to judge the software by

  1. the severity of the bugs (e.g. problems restoring = minor, loosing data = major)
  2. the quality of the support you get
  3. the speed at which bugs are fixed.

If, on the other side, the issues you experienced here were not caused by a bug but by a confusing user interface, then this should also be fixed and your help would be appreciated with this. Now that you have got it to work, can you say where you went wrong originally and how this might have been prevented by a better UI?

You may be interested to know that

It is apparent that some files need to be restored with the root permission. I don’t know why running the GUI with sudodid work. The -ignore-owner option of the restore command should help too.

The main issue here I think is the bug that the GUI didn’t report the error when encountering an error during the restore operation. I thought this was fixed in the latest 2.1.1 release – I’ll double check.

1 Like

Dear @TheBestPessimist and @gchen – and now also @Christoph

Heureka – I think we (!) succesed!

A photolibrary has landed on my new external harddisk – it seems like it’s a little smaller than I thought it would be, but as far as I can tell, all the photos seems to be in place.

Thank you, thank you, thank you!

As of your kind advise, @Christoph

I believe that you’re spot on in your diagnosis. And maybe that’s exactely what I needed to here. So for now I’m still the happy user of Duplicacy (and Backblaze).

As of the 2.1.0 beta it seems promising. I’ve tried to download and open the beta version, but with no luck (surprise!). So I’ll just wait till it’s not a Beta version any more :wink:

Once again: Thanks!

With grateful respect,
Laurids

2 Likes