![]() –asynchronous-upload-folder should show a bunch of roughly remote volume size (default 50 MB) files flowing through, if the preparation runs faster than the upload. several dblock files) in parallel, so gets a similar boost (and you can tune Advanced option – asynchronous-concurrent-upload-limit up from its default 4 if you want to see what happens) in a different way, attempting to keep a big pipe full despite inherent transmission limits of the TCP protocol which are reached due to speed-of-light limitations…Īdded support for new Amazon S3 feature - Multipart Uploads. Duplicati’s transfer will not split a file AFAIK, but can do multiple separate files (e.g. Multipart Uploads is possibly how Cyberduck is getting faster total throughput. V2.0.4.23-2.0.4.23_beta_ is pretty much v2.0.4.5-2.0.4.5_beta_ so the Canary with the initial (somewhat flawed) cut at parallel uploads represents code that’s about 4 months later. Why the older would work better than the current / latest beta I will uninstall the beta tomorrow on the server and replace with canary_ and do some further testing and revert.įor now it appears that the older canary flies 10X better than the beta. Will encryption + SSL I now get 5 MB/sec upload speed which is 10X better than I had before (however I am uloading different vbk files) On my Win 10 desktop (initial testing was from the backup storage server) - with this version I see s3. is available as a drop down selection (in the later beta_ it is not available so in my server upload (post 1) I entered it as a custom URL) I then selected the region eu-central-1 (which both versions describe as Frankfurt although Wasabi I think is Amsterdam - anyway I expect the eu-central-1 part remains the same hence it works) I am creating buckets in their their newer eu-central-1 region. I am aware of the Wasabi service degradation notice but havent experienced any issues with them myself. Hi, am unclear on the Duplicati version and why the older would work better than the current / latest beta but you’re right there looks to be something in this. Is an initial upload always slow and then speeds up after time when dedupe efficiencies kick in as daily backup deltas are added to the bucket? Thanks for any insights. Is this expected or am I missing anything here. I tried the same upload with default block size of 50 MB files, and no SSL or encryption and upload speed was only marginally better at 450-500 KB/sec. Is my experience a result of having enabled encryption or is this being affected by (inline?) deduplication algorithms or something else. The uploaded files when I look at the bucket are all 50 MB dblock AES files and a number of smaller dindex files. Is what I’m seeing pretty much the performance I can expect or is this an aberration and I should be getting closer to line speed? I realise its internet but I have tested at various times of day for a couple days now, also on different ISPs and its pretty consistent what I’m getting. I’m trying to understand why its 25X slower, since as it stands its making daily uploads like this infeasible and aside from this it looks to be quite promising a product. Using Duplicati I only get a maximum of about 400 KB/sec on the upload to Wasabi, no throttling is set. ![]() Internet is 100 Mbps 1:1 fibre, and getting 10 MB/sec uploads is not unusual for me. ![]() TNTdrive / Cyberduck I can upload these files to the Wasabi bucket at 7-10 MB/sec.This is the plain vbk file and no encryption is being added on or before upload. The upload files are Veeam backups 40 GB to 250 GB in size, dedupe friendly, not encrypted saved on above deduplicated Windows NTFS volume all in a single folder - total folder size about 1 TB across 10 files. Installed current version Duplicati - 2.0.4.23_beta_ġ28 GB RAM, 24 CPU cores Xeon Gold 6126. Can anyone confirm what I’m seeing with Duplicati performance is at expected levels or am I doing something that is very negatively affecting the upload speed.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |