IDrive e2 now integrated with Duplicacy - Fast S3 Compatible Cloud storage

Feature
,
#1

We launched IDrive e2 on April 13, 2022 offering no ingress or egress charges, storage starting at $0.004/GB/month and a fast network of 8 edge locations in the US and recently added location in Ireland. Duplicacy users! IDrive e2 is now available as a repository for your Duplicacy backups!

As a special, IDrive is offering 90% off plans for the first year, along with a 1TB 30 day trial for Duplicacy users! Please signup here: https://app.idrivee2.com/signup-duplicacy

We are also faster than AWS, Backblaze b2, and Wasabi, give our speed test a try

Use the IDrive® e2 storage as a repository for your Duplicacy backups. Create S3 Access Keys from the IDrive® e2 Access Keys tab and use them to establish connection with Duplicacy.

To access IDrive® e2 using S3 Access Keys,

  1. Download and install Duplicacy.

dup-scree1
dup-scree1800Ă—473 37.1 KB

  1. Launch the application and go to STORAGE in the LHS. Choose the IDrive® e2 tab.

dup-screen2
dup-screen2800Ă—473 28.4 KB

  1. Enter the access key details (created in IDrive® e2 account) and click on the Bucket listing icon.

dup-screen3
dup-screen3800Ă—473 37.2 KB

  1. Choose IDrive® e2 bucket for cloud storage destination and click Select.

dup-screen4
dup-screen4800Ă—473 21.7 KB

dup-screen5
dup-screen5800Ă—473 38.6 KB

  1. Click Continue, provide a name for the Storage and click Add.

dup-screen6
dup-screen6800Ă—473 27.8 KB

Once IDrive® e2 storage is added successfully, you can select IDrive e2 as the destination for your new backups.

Duplicacy sending spam to advertise iDrive?
Are you happy using iDrive e2 with Duplicacy
Indexing takes forever and backup ultimately fails
Commercial emails from duplicacy
Low cost / Archival storage discussion
Moving Away from Wasabi - GCA, Storj and IDrive e2?
#2

This is great! For example, if we want to migrate from another cloud storage provider, B2, for example. Is there a guide on how to do so somewhere? I tried to find information, but I could not locate that information.

Thanks!

#3

You should be able to just copy the data folder using any other tool, e.g. rclone, and then add newly copied folder in duplicacy as storage.

It may not make financial sense to migrate from b2: egress is expensive. Unless you route that through cloudflare, which costs your time.

I would wait until until archival storage is supported by duplicacy and migrate then. Using hot storage for backup is wasteful for vast majority of users, cost difference between various hot storage providers is negligible compared to cost savings with archival storage

1 Like
#4

Interesting, I’ll test it.

Just a note:

In Duplicacy nomenclature, repositories are the location of source files, backup locations are storages.

1 Like
#5

Hi, here is some helpful info on some migration tools that will work:
https://www.idrive.com/e2/data-migration
We would recommend flexify.io

1 Like
#6

Looks to me like iDrive is still slower than the competition from what I can see using their own speed test. That has been true for well over 10 years now and was still true when I last tried iDrive two months ago. iDrive’s gonna have to do better than this to get my attention.

image
image762Ă—519 41.4 KB

#7

It has been a hard experience to copy some Wasabi buckets to idrive e2. The copy starts but in the middle of the process errors like the ones below occur (different buckets, different storages):

Copying snapshot ******* at revision 193
Copying snapshot ******* at revision 194
Copying snapshot ******* at revision 195
Copying snapshot ******* at revision 196
Listing chunks/
^[OPFailed to list the directory chunks/: SerializationError: failed to unmarshal error message
        status code: 502, request id: , host id:
caused by: UnmarshalError: failed to unmarshal error message
        00000000  3c 68 74 6d 6c 3e 0d 0a  3c 68 65 61 64 3e 3c 74  |<html>..<head><t|
00000010  69 74 6c 65 3e 35 30 32  20 42 61 64 20 47 61 74  |itle>502 Bad Gat|
00000020  65 77 61 79 3c 2f 74 69  74 6c 65 3e 3c 2f 68 65  |eway</title></he|
00000030  61 64 3e 0d 0a 3c 62 6f  64 79 3e 0d 0a 3c 63 65  |ad>..<body>..<ce|
00000040  6e 74 65 72 3e 3c 68 31  3e 35 30 32 20 42 61 64  |nter><h1>502 Bad|
00000050  20 47 61 74 65 77 61 79  3c 2f 68 31 3e 3c 2f 63  | Gateway</h1></c|
00000060  65 6e 74 65 72 3e 0d 0a  3c 68 72 3e 3c 63 65 6e  |enter>..<hr><cen|
00000070  74 65 72 3e 6e 67 69 6e  78 3c 2f 63 65 6e 74 65  |ter>nginx</cente|
00000080  72 3e 0d 0a 3c 2f 62 6f  64 79 3e 0d 0a 3c 2f 68  |r>..</body>..</h|
00000090  74 6d 6c 3e 0d 0a                                 |tml>..|

caused by: expected element type <Error> but have <html>

Copying snapshot ******* at revision 93
Copying snapshot ******* at revision 94
Listing chunks/
Failed to list the directory chunks/: SerializationError: failed to unmarshal error message
        status code: 502, request id: , host id:
caused by: UnmarshalError: failed to unmarshal error message
        00000000  3c 68 74 6d 6c 3e 0d 0a  3c 68 65 61 64 3e 3c 74  |<html>..<head><t|
00000010  69 74 6c 65 3e 35 30 32  20 42 61 64 20 47 61 74  |itle>502 Bad Gat|
00000020  65 77 61 79 3c 2f 74 69  74 6c 65 3e 3c 2f 68 65  |eway</title></he|
00000030  61 64 3e 0d 0a 3c 62 6f  64 79 3e 0d 0a 3c 63 65  |ad>..<body>..<ce|
00000040  6e 74 65 72 3e 3c 68 31  3e 35 30 32 20 42 61 64  |nter><h1>502 Bad|
00000050  20 47 61 74 65 77 61 79  3c 2f 68 31 3e 3c 2f 63  | Gateway</h1></c|
00000060  65 6e 74 65 72 3e 0d 0a  3c 68 72 3e 3c 63 65 6e  |enter>..<hr><cen|
00000070  74 65 72 3e 6e 67 69 6e  78 3c 2f 63 65 6e 74 65  |ter>nginx</cente|
00000080  72 3e 0d 0a 3c 2f 62 6f  64 79 3e 0d 0a 3c 2f 68  |r>..</body>..</h|
00000090  74 6d 6c 3e 0d 0a                                 |tml>..|

caused by: expected element type <Error> but have <html>

Sometimes the process of chunks copying starts, but it stops in the middle with this error:

Failed to upload the chunk 864b1..................6bbed4b: SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.
        status code: 403, request id: 16F7205CC0408171, host id:

I was able to copy a bucket with a set of snapshots, and when running check to verify that everything is ok, the first time it worked, but the second time:

2022-06-10 13:36:05.683 INFO SNAPSHOT_CHECK Listing all chunks
2022-06-10 13:36:05.683 TRACE LIST_FILES Listing chunks/
2022-06-10 13:48:09.022 ERROR LIST_FILES Failed to list the directory chunks/: SerializationError: failed to unmarshal error message
	status code: 502, request id: , host id: 
caused by: UnmarshalError: failed to unmarshal error message
	00000000  3c 68 74 6d 6c 3e 0d 0a  3c 68 65 61 64 3e 3c 74  |<html>..<head><t|
00000010  69 74 6c 65 3e 35 30 32  20 42 61 64 20 47 61 74  |itle>502 Bad Gat|
00000020  65 77 61 79 3c 2f 74 69  74 6c 65 3e 3c 2f 68 65  |eway</title></he|
00000030  61 64 3e 0d 0a 3c 62 6f  64 79 3e 0d 0a 3c 63 65  |ad>..<body>..<ce|
00000040  6e 74 65 72 3e 3c 68 31  3e 35 30 32 20 42 61 64  |nter><h1>502 Bad|
00000050  20 47 61 74 65 77 61 79  3c 2f 68 31 3e 3c 2f 63  | Gateway</h1></c|
00000060  65 6e 74 65 72 3e 0d 0a  3c 68 72 3e 3c 63 65 6e  |enter>..<hr><cen|
00000070  74 65 72 3e 6e 67 69 6e  78 3c 2f 63 65 6e 74 65  |ter>nginx</cente|
00000080  72 3e 0d 0a 3c 2f 62 6f  64 79 3e 0d 0a 3c 2f 68  |r>..</body>..</h|
00000090  74 6d 6c 3e 0d 0a                                 |tml>..|

caused by: expected element type <Error> but have <html>

Yes, I noticed the nginx there in the middle of the returned HTML…

Note: all this on 3 different machines, two VMs and one “physical”.

I’m starting to think if idrive e2 is reliable to store my backups… :thinking:

2 Likes
#8

Just to add some comparison to your screenshot :

1137Ă—710 33.3 KB

#9

This will probably be ignored… and i know the reasons why it is the way it is… but whilst your offer prices are pretty sensational, the fact that they are only valid on a yearly subscription rules me out… there’s no way in today’s (and likely the coming future) climate that i could commit to paying $200 in one foul swoop in a years time for 5TB of storage…

If i were to purchase 5TB at $20 now… in a years time could i switch that to monthly billing?

#10

Regarding the errors reported above, a support ticket was opened that day. There goes a week with no response, let alone a solution. For my part idrive is ruled out as trusted storage.

3 Likes
#11

Hi, our support team will reach out to you

#14

Were you able to resolve these errors? I’m also receiving occasional ERROR UPLOAD_CHUNK / SignatureDoesNotMatch errors that disrupt the backup. The Backblaze B2 service works without any problems.

#15

Nope, I just gave up.

1 Like
#16

Thanks! I’m still waiting to hear back from support, but it seems likely the e2 service is not quite ready yet.

2 Likes
#17

I also tried it and got several errors, so I decided to stick with B2. The pricing is too close to justify the additional risk of going to a solution that is giving me (us) issues with something as crucial as my backup data.

#18

Just needed to note that iDrive has “fixed” their speedtest after being proven wrong about being faster than the competition. Looks to me like they altered their speedtest so that their EU-based server in Ireland is now competing only against US-based competitor servers, all of whom also operate EU servers…

Really?

image
image1012Ă—484 42 KB

2 Likes
#19

Thanks! I’m still waiting to hear back from support, but it seems likely the e2 service is not quite ready yet.

Indeed, not ready yet. I’m experiencing major performance issues listing buckets with 55K objects.
Support also leaves a lot to be desired, filed a ticket a month ago and no reply beyond the generic ack that the ticket was received. Tried to talk to them in chat all I get is “our engineers will get back to you”.
@IDrive any comments?

1 Like
#20

This is how iDrive has been for 15 years. They’ve made zero efforts to improve any of the primary issues identified by customers over that time. Still slow, still error prone, still clunky, still terrible customer support… since day one.

2 Likes
#21

As suggested in another topic, I gave them another chance, and…

INFO STORAGE_SET Storage set to s3://e2@********.idrivee*****.com/*********
TRACE CONFIG_ITERATIONS Using 16384 iterations for key derivation
INFO SNAPSHOT_CHECK Listing all chunks
TRACE LIST_FILES Listing chunks/
ERROR LIST_FILES Failed to list the directory chunks/: Service Unavailable: Server down for maintenance

:roll_eyes:

#22

Little IDrive OT:
I also tried it, so far with Synology Hyper Backup
Bucket (in Ireland) have 24K objects/500GB and no error/warning so far.

So, in the context of the experiences here, I’m quite surprised why I don’t have random failures as well. Error when listing files should be pretty universal?