• Created by Unknown User (escowles@ucsd.edu), last modified on Mar 20, 2014

Sprint Team

General

Meetings

3/10

3/11

  • A. Soroka
    • out sick
  • Eric James
    • Running into problems that should be documented
      • Can update the config, but that doesn't change what's shown by the repo – need to refresh.  Is there a simple way to refresh the repository?
      • Will add errors to the wiki
    • Content changes show up in the repo, but browser doesn't find it reliably because of caching issues, will write IT to demonstrate this
  • Unknown User (escowles@ucsd.edu)
    • Clustering worked once firewall was relaxed to allow nodes to talk to each other
    • Working through triplestore use cases
      • Most look like they are supported by what we have now
      • Will expand SPARQL Recipes to cover more of the use cases 

3/12

  • Eric James
    • Eclipse bugs yesterday, switching to IntelliJ.  Trying to get IT to verify federated content updates when filesystem is updated.
    • When changing repository.json and restarting repo, it's still using the old config.
      • Adam: Mode may be storing projection info in repository and not updating it for some reason.
  • A. Soroka
    • We are running into the limitations of JCR content type system, may need to do something else (implement our own, adopt a different one)
    • There are lots of interesting possibilities, but they aren't practical to implement quickly.
    • SPARQL may be a better strategy: in a transaction, a user could create content, run SPARQL queries to validate, and then commit or rollback based on that validation.  Could add a single-step process for doing that automatically.
    • Will put on wiki/mailing list for feedback.
  • Unknown User (escowles@ucsd.edu)
    • Finished reviewing triplestore use cases and found them well-supported.  Updated SPARQL Recipes and RESTful HTTP API - Containers to demonstrate some functionality, like updating multiple objects with a single SPARQL Update, using more vocabularies, etc.
    • Will investigate Mulgara-style recursion functionality.  This is not available in standard SPARQL, but Jena and/or Sesame may have similar extensions.
      • Adam: May be able to get hierarchy from repo, and then build a simple SPARQL query.
    • Will try to replicate Eric's federation config reloading issue.

3/13

3/14

  • Eric James
    • Hit problems with Eclipse, switched to IntelliJ
    • Having problems debugging federation config issues
      • Probably not productive to keep working on this
      • Will write up notes on federation and close the ticket
    • Will move on to testing authzn on federated filesystems
  • Unknown User (escowles@ucsd.edu)
    • Will update triplestore and large file uses cases
      • All of the triplestore use cases are satisfied by external triplestore or other repository functionality
      • File use cases are mostly satisfied, but some outstanding issues related to authzn.
        • Some use cases reference async functionality for HPSS, but that is waiting for Jersey upgrade
        • Testing large file ingest using REST API writing to federated fs, and copying large files between repo and federated filesystem.
  • Andrew Woods
    • Getting up to speed on sprint activity, will cleanup Pivotal tickets today
    • Will talk to David Wilcox about starting acceptance testing for triplestore and large file features
    • Will try to replicate Eric's bugs with Modeshape not reloading federated filesystem configuration after restart
      • Will both in-place configuration with Jetty, and external configuration with Tomcat to try to tease out possible environment/runtime issues.

3/17

  • Unknown User (escowles@ucsd.edu)
    • Fixing SPARQL Recipes (some objects weren't getting indexing enabled), and getting the recursive collection membership query working correctly (and simplifying it too)
    • Testing filesystem federation and data copying options (uploading to filesystem via REST API, copying between repo and federated filesystem)
      • Uploading to federated filesystem works, but messes up properties
      • Will file a bug on that and start trying to track it down
  • Eric James
    • Trying to get auth working with federated filesystem
    • Docs may be out of date, auth delegate config (docs still call it PEP)
      • Andrew: should look at auth.war for config, and email ff-tech/Mike Daines about the docs.
  • Andrew Woods
    • Reviewing tickets over weekend, things looking good
    • Testing Kai Sternad's fix for updating properties in a transaction
    • Tracking down Eric's problems re: filesystem federation config issues from last week
    • Writing up 4.0 feature list up in a prose format
  • David Wilcox
    • Working on feature docs messaging
    • Will coordinate with Andrew acceptance testing for large file support and external triplestore features
  • A. Soroka
    • Snow day

3/18

  • A. Soroka
    • Just getting back and starting to fix issues that Andrew had with PR.
    • Want to schedule special topics call for validation.
  • Andrew Woods
    • Talked to Kai Sternad about properties updates in transactions and merged in his update.
    • Also talked to Kai about some other transaction issues.
    • Looked at federation issues and agrees with Adam that there is a MODE issue here, but maybe we can figure out how to handle this or we are doing something wrong.  Will continue to look at this.
    • Merged in work from Mike Daines for user groups via HTTP headers and updated docs for how to wire that in.
    • Working on 4.0 feature set docs.
  • David Wilcox
    • Will be contacting users for doing acceptance testing of large file handling and external datastreams.
  • Eric James
    • Working on getting auth up and running with federated filesystem.
    • Using new config docs in the wik, which is running but not completely working.  Trying to track that down.
      • Andrew: make sure to ask for help if that isn't working
  • Unknown User (escowles@ucsd.edu)
    • Working on writing to filesystem federation using REST API.  The repository is writing links to versions that don't exist and this is breaking reading the node metadata.
    • We should probably have a supertype of fedora:resource that's not versionable, but this may be problematic.  Working on more limited approach to just trap the errors and continue with RDF generation instead.
      • Adam: We should be able to turn off the generation of those triples.  Or we can remove the mix:versionable mixin from fedora:resource, which would require explicitly adding the versionable mixin if desired (which is how it worked previously).  We may also want to ask about adding a method to the connector interface for querying whether a connector supports versioning.

3/19

  • Andrew Woods
    • Reviewing code updates and merging them.
    • Working on 4.0 feature documentation.
    • Trying to wrap up federation configuration updates.
    • Lots of meetings today and tomorrow.
    • Would like to get a release out before traveling on Sunday, so we need to get code changes finalized early enough to make that happen.
  • David Wilcox
    • Emailed people who submitted use cases for large files and external datastreams.
    • Expect testing to go forward over next few weeks with new 4.0 alpha release.
    • Will work with Andrew on messaging.
  • Eric James
    • Working on federation with authorization.
    • Found issue with root node access not having any roles, and opened PR to fix that.
    • Next step is setting up two federated directories and keeping one open and locking down the other one.
    • Looking into how to add mixin to federated node using REST API to set access roles.
  • A. Soroka
    • Working on content modeling agenda for tomorrow, trying to engage with some people outside of the core group to broaden input.
    • Will work with transform module.
  • Unknown User (escowles@ucsd.edu)
    • Updating  to use FedoraFileSystemConnector instead of Modeshape's FileSystemConnector.
    • Testing copying between repo and federated filesystem.
    • Versioning documentation changes.
    • Will continue with testing large files and clustering, and help with federation configuration issues.

3/20

  • No labels

All content on the LYRASIS Wiki is licensed under the CC BY (Attribution) license, unless otherwise noted.