...
| Excerpt |
|---|
Large files can be uploaded via the REST API, or projected into the repository using filesystem federation. Using HTTP uploads involves a small overhead compared to NFS- or CIFS-mounted disk. As file sizes grow (or as the number of files being processed grows), this overhead can make a significant difference in ingest performance. If you are ingesting a large number of multi-gigabyte files, we recommend you consider filesystem federation. |
| Warning | ||
|---|---|---|
| ||
Because of https://issues.jboss.org/browse/MODE-2103, ingesting files larger than Java heap space with certain Infinispan configuraitons (e.g. LevelDB) creates an OutOfMemoryError. The following TestCase can be used to reproduce the issue: https://github.com/futures/large-files-test Workaround: Use Infinispan file storage with a large heap, e.g.:
|
...