One of the questions we often get at DuraCloud is: How can I know how long it will take for me to upload all of my content to DuraCloud? To help answer that question, we've developed a very simple command-line tool called SyncRate. Don't let the "command-line" nature of this tool scare you, we'll walk you through the steps you need to follow below. Keep in mind that there many variables which can affect transfer speeds to DuraCloud. Your internet upload rate (which can be tested very easily) is the obvious first place to look, but things like the size of files being transferred, the media they are stored on, the local network speed, the amount of other traffic on the network, the routing paths used, and many other things can affect the numbers you see.
To run the SyncRate tool, you need two files, both of which you will need to download:
The driver jar file is the executable that you will run to perform the test. The configuration file tells SyncRate how the test should be run.
Remember where you store these files when you download them (it is simplest if you place them together in their own directory), you'll need that information later.
To run this tool, you will also need access to a DuraCloud space. If you are not yet a DuraCloud subscriber, you can use a test account. If you are a subscriber with administrative access to an Enterprise account, you can create your own space to use for these tests. If you are using a Preservation or Preservation Plus account, you can either use one of your existing spaces (some test content will be stored there), or submit a support ticket to have a temporary space created for this purpose.
Open the syncrate-config.properites file in a text editor (Notepad, Wordpad, TextEdit, or whichever editor you prefer is fine.) You will see a set of configuration parameters which you will need to set for your test to run.
- The host value should point to your DuraCloud instance. You should replace "[host]" with something like "myaccount.duracloud.org".
- The name of the space where test content will be stored as part of each test. You should replace "[spaceId]" with the name of your test space.
- The username you use to log in to DuraCloud. You should replace "[user]" with your username.
- The password you use to log in to DuraCloud. You should replace "[password]" with your password.
- The number of files to use in the test. The larger the number of files, the longer the test will take, but the more accurate the result. It is generally recommended to use numbers between 20 and 40. You should replace "[numfiles]" with the number you select.
- The size of each test file in Megabytes (MB). Try to estimate the average size of file in your dataset and use that number for this value. You should replace "[filesize-in-MB]" with your typical file size number.
- The number of processing threads that are run at the same time to move your content up to DuraCloud. The default value is 3, but the transfer rate generally improves with the number of threads until either the upload bandwidth is consumed, or the resources of the machine (the CPU and memory) are at full capacity. You should replace "[numthreads]" with your preferred thread count.
- This number is a good one to experiment with to try to determine the optimal number of threads for moving your content.
- Determines if the results for each test are also transferred to DuraCloud when the test is complete. The default is "false", which means the results will just be printed to the screen. Set this value to "true" if you'd like to share your results via DuraCloud (note that this will take a few extra minutes.)
To run the SyncRate test, following these steps will allow you test to run
- The first step is to open a terminal or command prompt. For instructions on doing this in Windows, click here. If you are using a Mac, you will need to open the "Terminal" application, which can be found under /Applications/Utilities.
- Next navigate to the folder where you