...
Sidebar: Randy asks if perhaps Brad has already done some of this plumbing with S3?
Brad: yesYes, in F3 for datastreams, but other data types need other tools. Employs S3fs FUSE -- mounts Linux filesystem to S3 buckets https://github.com/s3fs-fuse/s3fs-fuse.Some I/O transactions too fast, such as with triplestore. Block sizes matter–issue datastreamStore, by mounting S3 to Linux filesystem using YAS3FS. datastreamStore's I/O characteristics are asynch friendly. Performance gains could be had if Fedora's read/write block sizes could be fine tuned, for example from 4k to 128k for datastreamStore. Matter–issue is how to fine tune Fedora in this regard.
I/O characteristics are too fast for objectStore and resourceIndex.
7. Timelines and milestones
...