Page History

...

• You must have Java version 7 or above installed on your local system. If Java is not installed, or if a previous version is installed, you will need to download and install Java 7. To determine if the correct version of Java is installed, open a terminal or command prompt and enter

  Code Block
  java -version

  The version displayed should be 1.7.0 or above. If running this command generates an error, Java is likely not installed.

• You must have downloaded the Chunker Tool. It is available as a link near the top of this page.

Using the Chunker Tool

• To run the Chunker Tool, open a terminal or command prompt and navigate to the directory where the Chunker Tool is located and run the above command.

• The following options are available when running the Chunker Tool

  Short Option	Long Option	Arguments	Description
  -a	--add	<f t s>	add content from directory:<f> to space or directory:<t> of maximum chunk size:<s>, where the chunk size must have a unit suffix of K,M, or G — If the -c option is provided, the destination space <t> will be interpreted as the name of a space in the DuraCloud account found at the host:port provided in the -c option, otherwise the destination space will be interpreted as a directory on the local file system.
  -c	--cloud-store	<host:port>	use cloud store found at <host>:<port> as content destination
  -d	--dir-filter	<l>	limit processed directories to those listed in file-list:<l> — If the -d option is not used, all directories under the base source directory provided in the -a option will be included. The file specified by this option is expected to contain a list of directory names each on there own line. The list is converted to an OrFileFilter from Apache Commons IO
  -f	--file-filter	<l>	limit processed files to those listed in file-list:<l> – The file specified by this option is expected to contain a list of file names each on there own line. The list is converted to an OrFileFilter from Apache Commons IO
  -g	--generate	<outFile numBytes>	generate test data to <outFile> of <size> bytes — This option does not copy any files, it only generates test data files of the size specified in the give argument.
  -i	--ignore-large-files	no args	if this option is set, files over the chunk size specified in the 'add' option will be ignored.
  -p	--password	<password>	password of duracloud instance
  -u	--username	<username>	username of duracloud instance
  -x	--exclude-chunk-md5s	no args	if this option is set, chunk MD5s will NOT be preserved in the manifest — It is expected that this option is rarely used, but in certain situations where the MD5s of the segments of a file that needed to be chunked because the parent file was larger than the limit set in the -a option, not generating these MD5s improves performance.

...