Call in details:

Sprinters

Objectives

The objectives of sprint-04 are to:

  1. Test compatibility of exported Bags with:
    1. APTrust
    2. Perseids
    3. Archivematica (question)
  2. Test compatibility of import/export round-tripping between community and alternate Fedora implementations
  3. Import/export of versions
    1. Note: Want to keep upcoming Memento API alignment
  4. Lossless round-tripping (particularly dates)
    1. other round-tripping issues, e.g.:  FCREPO-2429 - Semantic differences between exports Open
  5. Resolve import bugs that were reported from v0.1 testing
  6. Verification tool
    1. Unicode-escaping when resources are exported leads to mismatch when those resources are re-imported
    2. Users are confused by the tool output
    3. Lower priority:
      1. Gracefully handling server-managed triples and timestamps that can't be updated
      2. Verifying Fedora-to-Fedora and disk-to-disk
      3. Anything special required for Bags?
  7. Lower-priority
    1. Importing into non-empty containers
      1. There may be several facets to this: importing into a container that already exists (other children of the same resource already exist) seems very useful, but syncing with an existing resource may be much more complex.  We should support the easy things, and be careful when tackling the more complex scenarios to maintain a good scope with stakeholder input.
    2. Maintain links in Bags with links to resources outside of Bags
      1. Revisit whether this is still an issue given the current Bag export/import functionality
    3. Incremental diffs of Bags, relating to sending updated Bags to preservation services, not re-transmitting large files that haven't changed, and not overwriting good content with content that's been corrupted, etc.
      1. Interesting functionality once the other functionality is solid

Resources

  1. Design - Import - Export
  2. Applications / tools for using and testing the import export
    1. Fedora 4.7.2 one-click (jetty-console jar : https://github.com/fcrepo4/fcrepo4/releases/tag/fcrepo-4.7.2
      1. Updated May 23, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-webapp-4.8.0-SNAPSHOT-jetty-console-a07a1a46.jar
    2. Fedora 0.1.0 Import / Export utility : https://github.com/fcrepo4-labs/fcrepo-import-export/releases/tag/fcrepo-import-export-0.1.0
      1. Do not use: Updated May 23, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-5240eae2.jar
      2. Updated May 24, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-d4780ca2.jar
      3. Updated May 26, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-0e42348f.jar
    3. Fedora 0.0.3 Import / Export verification utility : https://github.com/fcrepo4-labs/fcrepo-import-export-verify/releases/tag/0.0.3

    4. Steps for using the above


      # Download the utility:
      https://github.com/fcrepo4-labs/fcrepo-import-export/releases

      # Have a running Fedora
      If you do not have a Fedora to test with, you may want to start up the "one-click run":
      https://wiki.duraspace.org/display/FEDORA4x/Quick+Start#QuickStart-One-ClickRun

      # Have data in your Fedora
      If you do not have data in your Fedora, you will likely want to load some of your own or one of the existing example datasets:
      https://github.com/fcrepo4-labs/fcrepo-sample-dataset/tree/master/additional_datasets

      Although there are minimal instructions in the readme linked above, if you run into issues loading any of these datasets, I would be happy to help... the possibility of issues arising is not inconceivable.

      # Export your data as Bagit bags
      Here are some minimal instructions:
      https://github.com/fcrepo4-labs/fcrepo-import-export/blob/master/README.md#running-the-importexport-utility-with-a-bagit-support

      To export APTrust-style bags, use the ''--bag-profile aptrust" argument when running the utility.



  3. Import / Export utility tickets


  4. Import / Export verification tickets


Meetings

Meeting 01 - 2017-05-15

  • 9am ET

Attendees

Agenda

  1. Introductions
  2. Logistics
    1. Virtual daily stand-ups?
    2. IRC? 
    3. Conference calls?
    4. Email check-in?
    5. Sprint retrospective?
  3. Sprint Priorities
  4. Assign work

Minutes

  1. Kieran will be out the second week of the sprint
  2. Next meetings
    1. Wed 5/17 @10am ET
    2. Tues 5/23 @3pm ET
    3. Fri 5/19 @11am ET
  3. Dev teams
    1. Esmé and Longshou
    2. Mike and Ben
    3. Josh, Youn and Danny
  4. Testing / Docs teams
    1. Youn / Jim / Kieran / Bridget - detailed testing
  5. New tickets
    1. Import / Export between Fedora and Cavendish - Esmé
    2. Production roundtripping
      1. Duke - Jim
      2. Princeton - Esmé
      3. UMd - Josh
    3. Creation of small dataset for verification testing - Esmé
    4. Plan how versioning will be in line with Fedora specification
  6. Existing tickets

    1. - resolve with documentation and CND

    2. Longshou / Esmé
      2. ...
    3. - Josh
    4. - Danny
    5. - Josh
    6. - Danny to verify
    7. - Youn



Meeting 02 - 2017-05-17

  • 10am ET

Attendees

Agenda

  1. JIRA Process
  2. What can we do to make your time more effective?

Notes

JIRA

Review of JIRA process/workflow

Individual feedback

  1. Ben
    • working on memento
    • pairing works fine
  2. Bridget
    • import with perseids bags
    • there are files outside of the data dir that need to be imported
  3. Danny
    • work is going well with verification tool
    • had some formatting issues
    • would like to be able to have calls with youn/josh/danny
  4. Esme
    • have plenty to work on
  5. Harsha
    • need instructions for
    • UMich ICPSR
    • should chat with Mike and Ben around versioning
  6. Jim
    • all is good
    • will test when things
  7. Josh
    • good to have danny on the team
    • there are some unexplained errors
    • blockers: looking for stakeholder feedback on console/logging output
      • may be helpful testing export scenario
      • could Jim help with this?
  8. Longshou
    • all is good
  9. Mike
    • semi-blocker, PUT with 'handling lenient' does not work as desired if resource does not already exist
  10. Youn
    • all is good


Questions

  1. Do you have a full load of tasks between now and the end of the week?
  2. In what areas do you need help or see a gap with respect to achieving the sprint objectives?

Team

  1. Youn - need work to do, tickets have been addressed, can do testing
    1. testing changes to import/export
    2. testing steps
      1. start 4.7.2
      2. import plantpatents (and other datasets)
      3. export
      4. verify
      5. delete 4.7.2 (new port/context)
      6. import
      7. verify
  2. Ben - need testing for versioning, plate-full, need review of PR
  3. Danny - verification with bags, configuration file is not right
  4. Jim - need testing inbound links, will be testing duke data, testing-p-f
  5. Josh - need a ticket for verifying external content that is downloaded, p-f
  6. Esme - trailing slash
  7. Mike - plate-full
  8. Longshou - working verify digest
  9. Danny - verify bags and remaining issues


Meeting 04 - 2017-05-26

  • 11am ET

Attendees

Agenda

  1. Retrospective, from a process perspective...
    1. What went well?
    2. What went wrong?
    3. What could we do differently to improve?
  2. Outstanding tasks/work





Notes

Retrospective
  1. Ben
    • well: pairing
    • wrong: challenge of speculating about future versioning
    • change: who to ask for feedback, availability of team
  2. Danny
    • well: pairing (youn wanted to be in hangouts earlier)
    • well: productive
    • wrong: not fully available
    • wrong: synchronizing import/export with verification
    • change: meeting on Friday of first week (Mon1/Wed1/Fri1/Tue2/Fri2)
  3. Esme
    • well: good and plenty of tickets
    • well: pairing
    • well: current meeting schedule was good
    • wrong: merge conflicts
    • wrong: f4 issues
    • wrong: synchronizing import/export with verification
    • change: smaller, more frequent sprints
  4. Harsha
    • wrong: did not fully participate
  5. Jim
    • well: productive and connected with team
    • wrong: not paired
    • wrong: not fully available
    • wrong: synchronizing import/export with verification
  6. Josh
    • well: productive, kudos to Danny
    • wrong: synchronizing import/export with verification
    • wrong: verification tool ended up in a broken state
    • change: verification sprint follows import/export sprint
    • change: would be good for there to be activity between sprints
  7. Longshou
    • well: pairing
    • well: focused on testing
  8. Andrew
    • wrong: too non-sprint many meetings
    • wrong: merging conflicts
    • change: do people read standups?
  9. General
    • maybe different timeframes for different roles
      • dev: 2week sprints
      • testing: 1week sprints
    • having pairing hangouts was helpful
  10. Mike - mail-in
    • well: pairing
    • productive
    • interest in working after sprint
  11. Youn - mail-in
    • wrong: two weeks too long
    • change: verification sprint follows import/export sprint
    • wanted to be in hangouts with danny/josh earlier

Standups

IRC Template

[Import/Export Standup]
Finished yesterday: 
  {ticket titles and associated JIRA links}
  {and/or brief textual description}
Working on today:
  {ticket titles and associated JIRA links}
  {and/or brief textual description}
Blockers:
  {brief textual description}


 

<escowles> [Import/Export standup]
<escowles> Finished yesterday:
<escowles> * Adding option to overwrite tombstones on import https://jira.duraspace.org/browse/FCREPO-2202
<escowles> * Suppressing duplicate RDF types on re-import https://jira.duraspace.org/browse/FCREPO-2429
<escowles> Today:
<escowles> * Responding to code review comments
<escowles> * Support changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
<escowles> Blockers:
<escowles> * None

<awoods> [Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Created and assigned several tickets based on Sprint Kickoff meeting: https://wiki.duraspace.org/display/FF/2017-05+Import+-+Export+Sprint+04+Meetings
<awoods> - Reviewed Adding option to overwrite tombstones on import https://jira.duraspace.org/browse/FCREPO-2202
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> - Working "import tool looks for sha1 manifest file with capitalized filename" :
<awoods> https://jira.duraspace.org/browse/FCREPO-2443
<awoods> Blockers:
<awoods> - None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - Ran export and import using one-click jar and 10KIndirectContainers
<youn> - Attempted to run verify.py
<youn> Working on today:
<youn> - Run verify.py
<youn> - FCREPO-2369: verify.py fails on unicode-escaped characters; attempt to replicate error
<youn> - FCREPO-2438: document use of CND for namespaces; attempt to apply fix
<youn> - Will be offline in the afternoon for meetings, etc.
<youn> Blockers:
<youn> - urllib module in verify.py?

<mikeAtUVa> [Import/Export Standup]
<mikeAtUVa> Finished yesterday:
<mikeAtUVa> Spoke breifly with benpennell to strategize
<mikeAtUVa> Working on today:
<mikeAtUVa> https://jira.duraspace.org/browse/FCREPO-2432 adding support to update certain server-managed triples
<mikeAtUVa> - replace code that simplifies PUT interactions to use existing "handling-lenient, received-minimal" pattern
<mikeAtUVa> - attempt to implement intuitive date updates adding children with provided creation dates
<mikeAtUVa> - add test cases for binaries and ensure that they work
<mikeAtUVa> - address test failure on travis (didn't appear locally) : https://travis-ci.org/fcrepo4/fcrepo4/builds/232586336?utm_source=github_status&utm_medium=notification
<mikeAtUVa> - determine the interaction of forced modification dates with etags and their implications on caching and if-modified headers
<mikeAtUVa> Blockers:
<mikeAtUVa> - none

<benpennell> Finished yesterday:
<benpennell> * environment setup
<benpennell> * read through Mike's work on https://jira.duraspace.org/browse/FCREPO-2432
<benpennell> Working on today:
<benpennell> * familiarize myself with import/export codebase.
<benpennell> * familiarize myself with current and new versioning specifications, the challenges involved.
<benpennell> * strategize about how to represent versions
<benpennell> * work towards generating some tickets with Mike.
<benpennell> Blockers:
<benpennell> * is there previous work/discussion about exporting versions to reference?


<westgard> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> re-familiarized myself with code and tickets
<westgard> consulted with dbernstein regarding logging behavior ticket (FCREPO-2368)
<westgard> identified test data that demonstrates bug in unicode escaping (FCREPO-2369)
<westgard> Working on today:
<westgard> FCREPO-2303 (verify triples)
<westgard> FCREPO-2329 (handle missing resources during verification)
<westgard> Blockers:
<westgard> More feedback from stakeholders regarding desired logging behavior & command line options would be helpful (relates to FCREPO-2368)

<coblej>
Finished yesterday:
  Installed applications / tools for import export testing on workstation.
Working on today:
Verifying installation of applications / tools.
Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
Blockers:
Cannot load “main” sample datasets into one-click run Fedora 4.7.2.  “mvn -Dfcrepo.url=http://localhost:8080/rest/ exec:java” command results in “ERROR 08:29:39.119 (FedoraInvalidNamespaceExceptionMapper) NamespaceExceptionMapper caught an exception: Prefix fcr has not been registered” for each dataset.  (Loading the “additional datasets” via fcr:restore seems to work fine.)


<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-2428
<lsitu> Working on today:
<lsitu> Add support for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> Blockers:
<lsitu> N/A.

<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> https://jira.duraspace.org/browse/FCREPO-2448
<dbernstein> * Added setup.py to verify tool and setup up support for adding unit tests
<dbernstein> * Did some minor refactoring of command line parser using ‘click’ module
<dbernstein> * Add support for installing verify (now fcrepo-verify) on the path.
<dbernstein> * Pull request is in.
<dbernstein>
<dbernstein> Working on today:
<dbernstein>
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
<dbernstein> (provide full DEBUG-level logging for import-export verification tool)
<dbernstein> Blockers:
<dbernstein> None.

<bridgetalmas> [Import/Export Standup] Working on today:   Verify Perseids BagIt Profile  https://jira.duraspace.org/browse/FCREPO-2440 Blockers:   Mapping to LDP model   Import of tag manifest contents (https://jira.duraspace.org/browse/FCREPO-2444)

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - Ran verify.py to verify export of 10KIndirectContainers; attempted to verify import but stopped when I ran into lots of verification errors
<youn> - Started repository with modified repository.json and namespaces.cnd
<youn> Working on today:
<youn> - https://jira.duraspace.org/browse/FCREPO-2369 - backup and import data set that caused error
<youn> - https://jira.duraspace.org/browse/FCREPO-2438 - finish
<youn> - look into import verification errors
<youn> Blockers:
<youn> - none
<youn> Correction: - https://jira.duraspace.org/browse/FCREPO-2369 - restore and export data set that caused error

<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Verified installation of applications / tools.
<coblej> Working on today:
<coblej> Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
<coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2450
<coblej> Blockers:
<coblej> None

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Updated PR for overwriting tombstones: https://github.com/fcrepo4-labs/fcrepo-import-export/pull/76
<escowles> * Worked on support for changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
<escowles> Today:
<escowles> * Continue working on changing repository baseURL
<escowles> * Meetings
<escowles> Blockers:
<escowles> * None

<mikeAtUVa> [Import/Export Standup]
<mikeAtUVa> Finished yesterday:
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2432
<mikeAtUVa> - rolled back changes (in my work) that simplified PUT semantics
<mikeAtUVa> - identified additional work necessary to use existing "minimal" triples requests
<mikeAtUVa> - learned some more about how binary properties are stored, devised strategy for updating previously server-managed properties for binaries
<mikeAtUVa> Working on today:
<mikeAtUVa> - Hope to finish up https://jira.duraspace.org/browse/FCREPO-2432
<mikeAtUVa> Blockers:
<mikeAtUVa> - None

<awoods> [Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Completed: "import tool looks for sha1 manifest file with capitalized filename" : https://jira.duraspace.org/browse/FCREPO-2443
<awoods> - Reviewed: "Add ability to delete or overwrite tombstone on import" : https://jira.duraspace.org/browse/FCREPO-2202
<awoods> - Reviewed / Merged: "Semantic differences between exports" : https://jira.duraspace.org/browse/FCREPO-2429
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> Blockers:
<awoods> - None


<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2451
<dbernstein> (Break up verify.py into smaller more focused modules.)
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
<dbernstein> (provide full DEBUG-level logging for import-export verification tool)
<dbernstein>
<dbernstein> Working on today:
<dbernstein>
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Add support for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> Working on today:
<lsitu> Update PR for Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-2428
<lsitu> Blockers:
<lsitu> N/A

<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
<coblej> Working on today:
<coblej> Attempting to replicate verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369
<coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2450
<coblej> Blockers:
<coblej> None

<mikeAtUVa> [import/export standup]
<mikeAtUVa> Yesterday
<mikeAtUVa> * issued a PR for the server-managed-triples changes to fcrepo
<mikeAtUVa> * chatted with benpennell about versions
<mikeAtUVa> Today
<mikeAtUVa> * addressing reviewer comments for https://github.com/fcrepo4/fcrepo4/pull/1193
<mikeAtUVa> * identifying/completing changes necessary to import tooling
<mikeAtUVa> Blockers
<mikeAtUVa> None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - https://jira.duraspace.org/browse/FCREPO-2438 - in review
<youn> Working on today:
<youn> - https://jira.duraspace.org/browse/FCREPO-2369 - restore and export data set that caused Unicode errors; look into errors
<youn> Blockers:
<youn> - none

<escowles_> [Import/Export Standup]
<escowles_> Yesterday:
<escowles_> * Support for changing repository baseURL https://github.com/fcrepo4-labs/fcrepo-import-export/pull/81
<escowles_> Today:
<escowles_> * Started looking at re-enabling support for user-supplied namespace prefixes https://jira.duraspace.org/browse/FCREPO-2376
<escowles_> * Reviewing PR for allowing server-managed triples https://github.com/fcrepo4/fcrepo4/pull/1193
<escowles_> Blockers:
<escowles_> * None

<benpennell> Finished yesterday:
<benpennell> * Created ticket for export naming convention collisions https://jira.duraspace.org/browse/FCREPO-2452
<benpennell> * Discussed a proposed structure for exported versions with mikeAtUVa
<benpennell> Working on today:
<benpennell> * Make revisions to versioning proposal and share it for feedback
<benpennell> * Create tickets for export of versions, begin work if practical
<benpennell> * Check about previous work on version exporting (umgrosscol?)
<benpennell> Blockers:
<benpennell> * Need feedback on questions related to requirements/issues with exporting versions before proceeding

<awoods> [Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed: "Re-import of hierarchy" : https://jira.duraspace.org/browse/FCREPO-2428
<awoods> - Reviewed: "Optionally Update Server Managed Triples" : https://jira.duraspace.org/browse/FCREPO-2432
<awoods> - Reviewed: "Support changing repository baseURL" : https://jira.duraspace.org/browse/FCREPO-2335
<awoods> - Reviewed / Merged: "Add ability to delete or overwrite tombstone on import" : https://jira.duraspace.org/browse/FCREPO-2202
<awoods> - Reviewed / Merged: "Import/Export: Logging documentation" : https://jira.duraspace.org/browse/FCREPO-2425
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> Blockers:
<awoods> - None

<westgard> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> revised https://github.com/fcrepo4-labs/fcrepo-import-export-verify/pull/23
<westgard> created new tickets for handling of edge cases and errors in verification
<westgard> Working on today:
<westgard> continue testing for cause of https://jira.duraspace.org/browse/FCREPO-2369
<westgard> finish review of https://jira.duraspace.org/browse/FCREPO-2448
<westgard> Blockers:
<westgard> None


<coblej> youn: about to try it so we'll see ... will let you know
<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Verified that verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369 does not appear to apply to exports from Fedora 4.7.2.
<coblej> Working on today:
<coblej> Attempt to replicate verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369 with exports from Fedora 4.6.0. Consult with westgard and youn on remaining work to be done on that issue (if any).
<coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2450
<coblej> Blockers:
<coblej> None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - https://jira.duraspace.org/browse/FCREPO-2438: Document use of CND for namespaces: closed
<youn> - https://jira.duraspace.org/browse/FCREPO-2369: Import-export verification tool's rdf comparison fails on unicode-escaped characters: restored, exported, and verified resources from 4.7.2 repository without any verification failures
<youn> Working on today:
<youn> - follow up on FCREPO-2369; possibly, version issues, as noted on ticket
<youn> - familiarize myself with bag export and with bagit-python
<youn> Blockers:
<youn> - none

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Finished support for changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
<escowles> Today:
<escowles> * User-supplied namespace prefixes https://jira.duraspace.org/browse/FCREPO-2376
<escowles> * Export collections based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
<escowles> Blockers:
<escowles> * None

<benpennell> Finished yesterday:
<benpennell> * Initial proposal for version export plan in https://jira.duraspace.org/browse/FCREPO-2446
<benpennell> Working on today:
<benpennell> * Implementation of version export for https://jira.duraspace.org/browse/FCREPO-2458
<benpennell> * Revisions to version export structure as needed
<benpennell> Blockers:
<benpennell> * None

<awoods> [Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> - Please let me know if you have any tickets whose review you would like to be prioritized
<awoods> Blockers:
<awoods> - None

<westgard> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> Reviewed PRs for
<westgard> https://jira.duraspace.org/browse/FCREPO-2448 (Add python project setup scaffolding for fcrepo-import-export-verify),
<westgard> https://jira.duraspace.org/browse/FCREPO-2368 (provide full DEBUG-level logging for import-export verification tool), and
<westgard> https://jira.duraspace.org/browse/FCREPO-2451 (Break up verify.py into smaller more focused modules)
<westgard> Continued troubleshooting https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> Working on today:
<westgard> Try to get to resolution on https://jira.duraspace.org/browse/FCREPO-2469;
<westgard> https://jira.duraspace.org/browse/FCREPO-2460 (update readme (help text) and inline comments in newly refactored codebase);
<westgard> Attempt again to reproduce https://jira.duraspace.org/browse/FCREPO-2462 (verification tool gives random incorrect responses) and resolve if not possible.
<westgard> Blockers:
<westgard> None.

<mikeAtUVa> [Import/Export standup]
<mikeAtUVa> Yesterday
<mikeAtUVa> * addressed comments, improved https://jira.duraspace.org/browse/FCREPO-2432 (relaxed server managed triples)
<mikeAtUVa> * started settinng up environment to work on https://jira.duraspace.org/browse/FCREPO-2461 (add support for roundtripping of server managed triples)
<mikeAtUVa> Today:
<mikeAtUVa> * https://jira.duraspace.org/browse/FCREPO-2461
<mikeAtUVa> Blockers:
<mikeAtUVa> * None

<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
<dbernstein> (retool logging for import-export verification tool)
<dbernstein> More improvements - feature branch rebased with master and pull request is in.
<dbernstein>
<dbernstein> Working on today:
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)
<dbernstein>
<dbernstein> Blockers:
<dbernstein> None.


<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Replicated verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369 with exports from Fedora 4.6.0.
<coblej> Working on today:
<coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-2455
<coblej> Blockers:
<coblej> None

<mikeAtUVa> [import/export standup]
<mikeAtUVa> Finished last Friday:
<mikeAtUVa> - last modifications and changes to https://github.com/fcrepo4/fcrepo4/pull/1193 (relaxed server managed triples)
<mikeAtUVa> Today:
<mikeAtUVa> - mostly unrelated meetings
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2464 (documenting relaxed server managed triples)
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2461 (updating importer to support relaxed server managed triples)
<mikeAtUVa> Blockers:
<mikeAtUVa> - probably can't fully finish the importer updates without a version of 4.7.4 available for download for integration tests

<escowles> [Import/Export Standup]
<escowles> Last Friday:
<escowles> * Debugged parallel build failures https://jira.duraspace.org/browse/FCREPO-2466
<escowles> Today:
<escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
<escowles> Blockers:
<escowles> * None

<benpennell> Finished yesterday:
<benpennell> * Second proposal for structure of version exports for https://jira.duraspace.org/browse/FCREPO-2446
<benpennell> Working on today:
<benpennell> * Finish up implementation and unit tests for version export, create PR https://jira.duraspace.org/browse/FCREPO-2458
<benpennell> * Start thinking about implementation of versions importing
<benpennell> Blockers:
<benpennell> * none

<awoods> [Import/Export Standup]
<awoods> Finished last Friday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None

<lsitu> [Import/Export Standup]
<lsitu> Finished last Friday:
<lsitu> Rebase PR and refactor codes to fix conflicts for Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-2428
<lsitu> Updated PR for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> Working on today:
<lsitu> Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2418
<lsitu> Imporve PR for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> Blockers:
<lsitu> None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters) - added note on Unicode errors to README
<youn> - tested bag export and verification with bagit-python
<youn> Working on today:
<youn> - follow up on comments on FCREPO-2369
<youn> - get feedback on (and work on) ideas for videos
<youn> Blockers:
<youn> - none

<westgard> [Import/Export Standup]
<westgard> Finished Friday:
<westgard> https://jira.duraspace.org/browse/FCREPO-2460 (update readme (help text) and inline comments in newly refactored codebase)
<westgard> https://jira.duraspace.org/browse/FCREPO-2463 (minor formatting fixes in verification tool)
<westgard> Continued troubleshooting of https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> Working on today:
<westgard> https://jira.duraspace.org/browse/FCREPO-2457 (handle failed connection gracefully)
<westgard> Continued troubleshooting of https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> Blockers:
<westgard> None.

<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> * Nothing finished (out most of the day)
<dbernstein> Working on today:
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)
<dbernstein> Blockers:
<dbernstein> None.



<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters) - used sample RDF containing Unicode to test the verification tool with the one click for 4.6.0 and 4.7.3-RC
<youn> - started proposal for videos
<youn> Working on today:
<youn> - finish proposal for videos
<youn> Blockers:
<youn> - none

westgard> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> started https://jira.duraspace.org/browse/FCREPO-2457 (handle failed connection gracefully)
<westgard> Working on today:
<westgard> finish FCREPO-2457
<westgard> Blockers:
<westgard> None.

<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Working on today:
<coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-2455
<coblej> Blockers:
<coblej> None

<awoods> [Import/Export Standup]
<awoods> Finished last Friday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None

<mikeAtUVa> [import/export sprint standup]
<mikeAtUVa> Yesterday:
<mikeAtUVa> - mostly worked on urelated things
<mikeAtUVa> Today:
<mikeAtUVa> - Finish up https://jira.duraspace.org/browse/FCREPO-2461
<mikeAtUVa> - Determine if more changes to fcrepo are in order (for versioning) in the scope of this sprint
<mikeAtUVa> Blockers:
<mikeAtUVa> - none

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
<escowles> * Fix Bag import using config file https://jira.duraspace.org/browse/FCREPO-2462
<escowles> Today:
<escowles> * Rebase PR #84 (exporting members based on inbound links)
<escowles> * Not sure after that: whatever needs help
<escowles> Blockers:
<escowles> * None

<benpennell> [Import/Export Standup]
<benpennell> Finished yesterday:
<benpennell> * Create PR for export of versions https://jira.duraspace.org/browse/FCREPO-2458
<benpennell> Working on today:
<benpennell> * Planning and implementation of version import https://jira.duraspace.org/browse/FCREPO-2459
<benpennell> * Some local stuff
<benpennell> Blockers:
<benpennell> * none

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2418
<lsitu> Consolidate the findRepositoryRoot method for PR with round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> Working on today:
<lsitu> Improve Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2418?
<lsitu> Will find more tickets.
<lsitu> Blockers:
<lsitu> None


<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Working on today:
<coblej> Testing sprint changes using interim code releases
<coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-2455
<coblej> Blockers:
<coblej> None

<awoods> Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> - Created testing recipes (please everyone do at least one unique test): https://wiki.duraspace.org/display/FF/Import+-+Export+Testing+Recipes
<awoods> - Uploaded recent versions of import/export utility and Fedora-master: https://wiki.duraspace.org/display/FF/2017-05+Import+-+Export+Sprint+04+Meetings#id-2017-05Import-ExportSprint04Meetings-Resources
<awoods> - Created ticket for testing import into Cavendish: https://jira.duraspace.org/browse/FCREPO-2476
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - Waiting on resolution to: new bug "import-export does not respect containment predicates when pointed at rest/" (https://jira.duraspace.org/browse/FCREPO-2474)

<mikeAtUVa> [import/export sprint standup]
<mikeAtUVa> Yesterday:
<mikeAtUVa> - https://github.com/fcrepo4-labs/fcrepo-import-export/pull/88 updated importer to support lossless roundtripping of RDF
<mikeAtUVa> Today:
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2464 (document "relaxed" triples mode)
<mikeAtUVa> - I'll take a look at https://github.com/fcrepo4-labs/fcrepo-import-export/pull/85 if it's not already reviewed/merged
<mikeAtUVa> - Look into aligning versioning with spec, providing feedback where necessary
<mikeAtUVa> Blockers:
<mikeAtUVa> - none

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - draft proposal for videos and ***WELCOME YOUR FEEDBACK*** https://docs.google.com/document/d/1CzvJlZ3m3eEhHgVJJY0hdGerPMxRIRaK9X05WhCLKpo/edit?usp=sharing
<youn> Working on today:
<youn> - test bag import export and version import export
<youn> - test predicates and inbound with lubm
<youn> - https://jira.duraspace.org/browse/FCREPO-2473 (verification tool should handle import-export v1.1 config files)
<youn> Blockers:
<youn> - none

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Improved and rebased the PR for Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2418
<lsitu> Working on today:
<lsitu> Not sure: can help on anything else.
<lsitu> Blockers:
<lsitu> None

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
<escowles> * Fix Bag import using config file https://jira.duraspace.org/browse/FCREPO-2462
<escowles> Today:
<escowles> * Trailing slash issues https://jira.duraspace.org/browse/FCREPO-2467
<escowles> * Containment predicates don't work when pointed at /rest https://jira.duraspace.org/browse/FCREPO-2474
<escowles> * Squashing bugs from testing
<escowles> Blockers:
<escowles> * None

<benpennell> [Import/Export Standup]
<benpennell> Finished yesterday:
<benpennell> * A bunch of local stuff
<benpennell> * Some decisions about requirements for import of versions related to timestamps
<benpennell> Working on today:
<benpennell> * Implementation of version import https://jira.duraspace.org/browse/FCREPO-2459
<benpennell> Blockers:
<benpennell> * none

<westgardj> [Import/Export Standup]
<westgardj> Finished yesterday:
<westgardj>   Finished https://jira.duraspace.org/browse/FCREPO-2457 (handle failed connection gracefully)
<westgardj>   Tested current master branch of import-export tool
<westgardj> Working on today:
<westgardj>   https://jira.duraspace.org/browse/FCREPO-2449
<westgardj>   Additional testing of import-export and verifier
<westgardj> Blockers:
<westgardj>   None.

<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> *
<dbernstein> Working on today:
<dbernstein> * finishing up https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)this morning
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2475
<dbernstein> (verifcation tool should log to timestamped log files)
<dbernstein>
<dbernstein> Blockers:
<dbernstein> None.


<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Document export format in partial response to https://jira.duraspace.org/browse/FCREPO-2455 (Import/Export: Document import structural expectations)
<coblej> Working on today:
<coblej> Testing sprint changes using interim code releases
<coblej> Blockers:
<coblej> None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - tested export with lubm
<youn> - regenerated lubm backup, replacing link for external content; https://yale.box.com/s/0rkv4q1akg7g1w3oq4zhnrkafeppmplg needs to be added to github repo; previous versions should be deleted
<youn> Working on today:
<youn> - test lubm import and verify export and import
<youn> - test versions and bags
<youn> - https://jira.duraspace.org/browse/FCREPO-2473 (verification tool should handle import-export v1.1 config files)
<youn> Blockers:
<youn> - none

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Trailing slash issues https://jira.duraspace.org/browse/FCREPO-2467
<escowles> * Containment predicates don't work when pointed at /rest https://jira.duraspace.org/browse/FCREPO-2474
<escowles> * Test import into Cavendish https://jira.duraspace.org/browse/FCREPO-2476
<escowles> Today:
<escowles> * findRepositoryRoot should have a sensible fallback https://jira.duraspace.org/browse/FCREPO-2477
<escowles> * Error importing export with inbound references https://jira.duraspace.org/browse/FCREPO-2483
<escowles> * Squashing bugs from testing
<escowles> * Couple meetings
<escowles> Blockers:
<escowles> * None

<awoods> Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None

<mikeAtUVa> [import/export sprint standup]
<mikeAtUVa> Finished Yesterday:
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2464 documented "relaxed" triple mode
<mikeAtUVa> Working on Today:
<mikeAtUVa> - testing scenarios
<mikeAtUVa> - comments for https://github.com/fcrepo4-labs/fcrepo-import-export/pull/88
<mikeAtUVa> Blockers:
<mikeAtUVa> none

<benpennell> [Import/Export Standup]
<benpennell> Finished yesterday:
<benpennell> * Created ticket for issue with generated relations in versions https://jira.duraspace.org/browse/FCREPO-2479
<benpennell> Working on today:
<benpennell> * Respond to feedback on version export PR
<benpennell> * Continue to work on initial implementation of version import ticket
<benpennell> * Can't guarantee version import will be done by the end of the sprint, it will depend on how smoothly today goes and feedback on the export, but I hope to have a first pass at it
<benpennell> Blockers
<benpennell> * none

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Testing export and import the plant patent dataset (restored from plants.tar.gz) with options -b, -g (default/aptrust), -i, -p, -t, -x in https://wiki.duraspace.org/display/FF/Import+-+Export+Testing+Recipes
<lsitu> Working on today:
<lsitu> Use the verification tool to verify import/export.
<lsitu> Fix bugs that coming up from from testing.
<lsitu> Blockers:
<lsitu> It seems that the verification tool works fine for binary export at this time but has limitation on other options. What can we test now?


<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Two test scenarios using then-current code, documented at https://wiki.duraspace.org/display/FF/Import+-+Export+Testing+Recipes .
<coblej> Working on today:
<coblej> Testing sprint changes using interim code releases against subset of production-like Duke data ( https://jira.duraspace.org/browse/FCREPO-2450 )
<coblej> Blockers:
<coblej> None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - tested export with lubm; tried to test import
<youn> - responded to feedback on https://jira.duraspace.org/browse/FCREPO-2299 (Import Export Videos)
<youn> Working on today:
<youn> - sprint feedback
<youn> Blockers:
<youn> - none

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * findRepositoryRoot should have a sensible fallback https://jira.duraspace.org/browse/FCREPO-2477
<escowles> * Error importing export with inbound references https://jira.duraspace.org/browse/FCREPO-2483
<escowles> * Only writing config file if specified https://jira.duraspace.org/browse/FCREPO-2430
<escowles> * Adding If-Modified-Since header to PUT-to-update requests https://jira.duraspace.org/browse/FCREPO-2498
<escowles> Today:
<escowles> * Rebasing PRs and responding to code review
<escowles> * Available to fix any last-minute bugs
<escowles> Blockers:
<escowles> * None

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Improve logging for HTTP exception in export with binary excluded: https://jira.duraspace.org/browse/FCREPO-2480.
<lsitu> Tested the the vrification tool and replcate the errors.
<lsitu> Tested the export/import tool and the vrification tool from master branch with Fedora fcrepo-webapp-4.8.0-SNAPSHOT-jetty-console-a07a1a46: https://wiki.duraspace.org/display/FF/Import+-+Export+Testing+Recipes.
<lsitu> Working on today:
<lsitu> Test export/import tool and use the verification tool to verify the result.
<lsitu> Fix bugs that are coming up from from testing.
<lsitu> Blockers:
<lsitu> None

<awoods> Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None