Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Design - Import - Export
  2. Applications / tools for using and testing the import export
    1. Fedora 4.7.2 one-click (jetty-console jar : https://github.com/fcrepo4/fcrepo4/releases/tag/fcrepo-4.7.2
      1. Updated May 23, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-webapp-4.8.0-SNAPSHOT-jetty-console-a07a1a46.jar
    2. Fedora 0.1.0 Import / Export utility : https://github.com/fcrepo4-labs/fcrepo-import-export/releases/tag/fcrepo-import-export-0.1.0
        Fedora 0.0.3 Import / Export verification utility
        1. Do not use: Updated May 23, 2017https://
        github
        1. s3.amazonaws.com/
        fcrepo4
        1. f4-
        labs
        1. artifacts/fcrepo-import-export-
        verify/releases/tag/
        1. 0.
        0.3

        Steps for using the above

        Expand Panel# Download the utility:
        1. 1.1-SNAPSHOT-5240eae2.jar
        2. Updated May 24, 2017: 
        1. https://
        github
        1. s3.amazonaws.com/
        fcrepo4
        1. f4-
        labs
        1. artifacts/fcrepo-import-export
        /releases# Have a running Fedora
        If you do not have a Fedora to test with, you may want to start up the "one-click run":
        1. -0.1.1-SNAPSHOT-d4780ca2.jar
        2. Updated May 26, 2017: https://
        wiki
        1. s3.
        duraspace
        1. amazonaws.
        org
        1. com/
        display/FEDORA4x/Quick+Start#QuickStart-One-ClickRun
        1. f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-0e42348f.jar
      1. Fedora 0.0.3 Import / Export verification utility : # Have data in your Fedora
        If you do not have data in your Fedora, you will likely want to load some of your own or one of the existing example datasets:
        https://github.com/fcrepo4-labs/fcrepo-import-sampleexport-datasetverify/treereleases/tag/0.0.3
      2. Steps for using the above

        Expand


        Panel

        # Download the utility

        master/additional_datasets

        Although there are minimal instructions in the readme linked above, if you run into issues loading any of these datasets, I would be happy to help... the possibility of issues arising is not inconceivable.

        # Export your data as Bagit bags
        Here are some minimal instructions:
        https://github.com/fcrepo4-labs/fcrepo-import-export/blob/master/README.md#running-the-importexport-utility-with-a-bagit-support

        To export APTrust-style bags, use the ''--bag-profile aptrust" argument when running the utility.

        releases

        # Have a running Fedora
        If you do not have a Fedora to test with, you may want to start up the "one-click run":
        https://wiki.duraspace.org/display/FEDORA4x/Quick+Start#QuickStart-One-ClickRun

        # Have data in your Fedora
        If you do not have data in your Fedora, you will likely want to load some of your own or one of the existing example datasets:
        https://github.com/fcrepo4-labs/fcrepo-sample-dataset/tree/master/additional_datasets

        Although there are minimal instructions in the readme linked above, if you run into issues loading any of these datasets, I would be happy to help... the possibility of issues arising is not inconceivable.

        # Export your data as Bagit bags
        Here are some minimal instructions:
        https://github.com/fcrepo4-labs/fcrepo-import-export/blob/master/README.md#running-the-importexport-utility-with-a-bagit-support

        To export APTrust-style bags, use the ''--bag-profile aptrust" argument when running the utility.



    3. Import / Export utility tickets

      Expand

      Jira
      serverDuraSpace JIRA
      jqlQueryfilter=13801
      serverIdc815ca92-fd23

      Import / Export utility tickets

      Expand

      Jira
      serverDuraSpace JIRA
      jqlQueryfilter=13801
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5


    4. Import / Export verification tickets

      Expand

      Jira
      serverDuraSpace JIRA
      jqlQueryfilter=14101
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5


    ...

    Expand
    titleMeeting 02 - 2017-05-17

    Meeting 02 - 2017-05-17

    • 10am ET

    Attendees

    Agenda

    1. JIRA Process
    2. What can we do to make your time more effective?

    Notes

    JIRA

    Review of JIRA process/workflow

    Individual feedback

    1. Ben
      • working on memento
      • pairing works fine
    2. Bridget
      • import with perseids bags
      • there are files outside of the data dir that need to be imported
    3. Danny
      • work is going well with verification tool
      • had some formatting issues
      • would like to be able to have calls with youn/josh/danny
    4. Esme
      • have plenty to work on
    5. Harsha
      • need instructions for
      • UMich ICPSR
      • should chat with Mike and Ben around versioning
    6. Jim
      • all is good
      • will test when things
    7. Josh
      • good to have danny on the team
      • there are some unexplained errors
      • blockers: looking for stakeholder feedback on console/logging output
        • may be helpful testing export scenario
        • could Jim help with this?
    8. Longshou
      • all is good
    9. Mike
      • semi-blocker, PUT with 'handling lenient' does not work as desired if resource does not already exist
    10. Youn
      • all is good

    ...


    Expand

    IRC Template

    No Format
    [Import/Export Standup]
    Finished yesterday: 
      {ticket titles and associated JIRA links}
      {and/or brief textual description}
    Working on today:
      {ticket titles and associated JIRA links}
      {and/or brief textual description}
    Blockers:
      {brief textual description}
    titleMeeting 03 - 2017-05-23

    Questions

    1. Do you have a full load of tasks between now and the end of the week?
    2. In what areas do you need help or see a gap with respect to achieving the sprint objectives?

    Team

    1. Youn - need work to do, tickets have been addressed, can do testing
      1. testing changes to import/export
      2. testing steps
        1. start 4.7.2
        2. import plantpatents (and other datasets)
        3. export
        4. verify
        5. delete 4.7.2 (new port/context)
        6. import
        7. verify
    2. Ben - need testing for versioning, plate-full, need review of PR
    3. Danny - verification with bags, configuration file is not right
    4. Jim - need testing inbound links, will be testing duke data, testing-p-f
    5. Josh - need a ticket for verifying external content that is downloaded, p-f
    6. Esme - trailing slash
    7. Mike - plate-full
    8. Longshou - working verify digest
    9. Danny - verify bags and remaining issues


    Expand
    titleMeeting 04 - 2017-05-26

    Meeting 04 - 2017-05-26

    • 11am ET

    Attendees

    Agenda

    1. Retrospective, from a process perspective...
      1. What went well?
      2. What went wrong?
      3. What could we do differently to improve?
    2. Outstanding tasks/work

      1. Expand
        titleImport/Export tickets

        Jira
        serverDuraSpace JIRA
        jqlQueryfilter=13801
        serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5



      2. Expand
        titleImport/Export Verification tickets

        Jira
        serverDuraSpace JIRA
        jqlQueryfilter=14101
        serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5


    Notes

    Retrospective
    1. Ben
      • well: pairing
      • wrong: challenge of speculating about future versioning
      • change: who to ask for feedback, availability of team
    2. Danny
      • well: pairing (youn wanted to be in hangouts earlier)
      • well: productive
      • wrong: not fully available
      • wrong: synchronizing import/export with verification
      • change: meeting on Friday of first week (Mon1/Wed1/Fri1/Tue2/Fri2)
    3. Esme
      • well: good and plenty of tickets
      • well: pairing
      • well: current meeting schedule was good
      • wrong: merge conflicts
      • wrong: f4 issues
      • wrong: synchronizing import/export with verification
      • change: smaller, more frequent sprints
    4. Harsha
      • wrong: did not fully participate
    5. Jim
      • well: productive and connected with team
      • wrong: not paired
      • wrong: not fully available
      • wrong: synchronizing import/export with verification
    6. Josh
      • well: productive, kudos to Danny
      • wrong: synchronizing import/export with verification
      • wrong: verification tool ended up in a broken state
      • change: verification sprint follows import/export sprint
      • change: would be good for there to be activity between sprints
    7. Longshou
      • well: pairing
      • well: focused on testing
    8. Andrew
      • wrong: too non-sprint many meetings
      • wrong: merging conflicts
      • change: do people read standups?
    9. General
      • maybe different timeframes for different roles
        • dev: 2week sprints
        • testing: 1week sprints
      • having pairing hangouts was helpful
    10. Mike - mail-in
      • well: pairing
      • productive
      • interest in working after sprint
    11. Youn - mail-in
      • wrong: two weeks too long
      • change: verification sprint follows import/export sprint
      • wanted to be in hangouts with danny/josh earlier

    Standups

    IRC Template

    No Format
    [Import/Export Standup]
    Finished yesterday: 
      {ticket titles and associated JIRA links}
      {and/or brief textual description}
    Working on today:
      {ticket titles and associated JIRA links}
      {and/or brief textual description}
    Blockers:
      {brief textual description}


    Expand
    titleStand-up report - 2017-05-16

     

    <escowles> [Import/Export standup]
    <escowles> Finished yesterday:
    <escowles> * Adding option to overwrite tombstones on import https://jira.duraspace.org/browse/FCREPO-2202
    <escowles> * Suppressing duplicate RDF types on re-import https://jira.duraspace.org/browse/FCREPO-2429
    <escowles> Today:
    <escowles> * Responding to code review comments
    <escowles> * Support changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
    <escowles> Blockers:
    <escowles> * None

    <awoods> [Import/Export Standup]
    <awoods> Finished yesterday:
    <awoods> - Created and assigned several tickets based on Sprint Kickoff meeting: https://wiki.duraspace.org/display/FF/2017-05+Import+-+Export+Sprint+04+Meetings
    <awoods> - Reviewed Adding option to overwrite tombstones on import https://jira.duraspace.org/browse/FCREPO-2202
    <awoods> Working on today:
    <awoods> - Reviewing any tickets that are completed
    <awoods> - Working "import tool looks for sha1 manifest file with capitalized filename" :
    <awoods> https://jira.duraspace.org/browse/FCREPO-2443
    <awoods> Blockers:
    <awoods> - None

    <youn> [Import/Export Standup]
    <youn> Finished yesterday:
    <youn> - Ran export and import using one-click jar and 10KIndirectContainers
    <youn> - Attempted to run verify.py
    <youn> Working on today:
    <youn> - Run verify.py
    <youn> - FCREPO-2369: verify.py fails on unicode-escaped characters; attempt to replicate error
    <youn> - FCREPO-2438: document use of CND for namespaces; attempt to apply fix
    <youn> - Will be offline in the afternoon for meetings, etc.
    <youn> Blockers:
    <youn> - urllib module in verify.py?

    <mikeAtUVa> [Import/Export Standup]
    <mikeAtUVa> Finished yesterday:
    <mikeAtUVa> Spoke breifly with benpennell to strategize
    <mikeAtUVa> Working on today:
    <mikeAtUVa> https://jira.duraspace.org/browse/FCREPO-2432 adding support to update certain server-managed triples
    <mikeAtUVa> - replace code that simplifies PUT interactions to use existing "handling-lenient, received-minimal" pattern
    <mikeAtUVa> - attempt to implement intuitive date updates adding children with provided creation dates
    <mikeAtUVa> - add test cases for binaries and ensure that they work
    <mikeAtUVa> - address test failure on travis (didn't appear locally) : https://travis-ci.org/fcrepo4/fcrepo4/builds/232586336?utm_source=github_status&utm_medium=notification
    <mikeAtUVa> - determine the interaction of forced modification dates with etags and their implications on caching and if-modified headers
    <mikeAtUVa> Blockers:
    <mikeAtUVa> - none

    <benpennell> Finished yesterday:
    <benpennell> * environment setup
    <benpennell> * read through Mike's work on https://jira.duraspace.org/browse/FCREPO-2432
    <benpennell> Working on today:
    <benpennell> * familiarize myself with import/export codebase.
    <benpennell> * familiarize myself with current and new versioning specifications, the challenges involved.
    <benpennell> * strategize about how to represent versions
    <benpennell> * work towards generating some tickets with Mike.
    <benpennell> Blockers:
    <benpennell> * is there previous work/discussion about exporting versions to reference?


    <westgard> [Import/Export Standup]
    <westgard> Finished yesterday:
    <westgard> re-familiarized myself with code and tickets
    <westgard> consulted with dbernstein regarding logging behavior ticket (FCREPO-2368)
    <westgard> identified test data that demonstrates bug in unicode escaping (FCREPO-2369)
    <westgard> Working on today:
    <westgard> FCREPO-2303 (verify triples)
    <westgard> FCREPO-2329 (handle missing resources during verification)
    <westgard> Blockers:
    <westgard> More feedback from stakeholders regarding desired logging behavior & command line options would be helpful (relates to FCREPO-2368)

    <coblej>
    Finished yesterday:
      Installed applications / tools for import export testing on workstation.
    Working on today:
    Verifying installation of applications / tools.
    Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
    Blockers:
    Cannot load “main” sample datasets into one-click run Fedora 4.7.2.  “mvn -Dfcrepo.url=http://localhost:8080/rest/ exec:java” command results in “ERROR 08:29:39.119 (FedoraInvalidNamespaceExceptionMapper) NamespaceExceptionMapper caught an exception: Prefix fcr has not been registered” for each dataset.  (Loading the “additional datasets” via fcr:restore seems to work fine.)


    Expand
    titleStand-up report - 2017-05-17

    <lsitu> [Import/Export Standup]
    <lsitu> Finished yesterday:
    <lsitu> Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-2428
    <lsitu> Working on today:
    <lsitu> Add support for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
    <lsitu> Blockers:
    <lsitu> N/A.

    <dbernstein> [Import/Export Standup]
    <dbernstein> Finished yesterday:
    <dbernstein> https://jira.duraspace.org/browse/FCREPO-2448
    <dbernstein> * Added setup.py to verify tool and setup up support for adding unit tests
    <dbernstein> * Did some minor refactoring of command line parser using ‘click’ module
    <dbernstein> * Add support for installing verify (now fcrepo-verify) on the path.
    <dbernstein> * Pull request is in.
    <dbernstein>
    <dbernstein> Working on today:
    <dbernstein>
    <dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
    <dbernstein> (provide full DEBUG-level logging for import-export verification tool)
    <dbernstein> Blockers:
    <dbernstein> None.

    <bridgetalmas> [Import/Export Standup] Working on today:   Verify Perseids BagIt Profile  https://jira.duraspace.org/browse/FCREPO-2440 Blockers:   Mapping to LDP model   Import of tag manifest contents (https://jira.duraspace.org/browse/FCREPO-2444)

    <youn> [Import/Export Standup]
    <youn> Finished yesterday:
    <youn> - Ran verify.py to verify export of 10KIndirectContainers; attempted to verify import but stopped when I ran into lots of verification errors
    <youn> - Started repository with modified repository.json and namespaces.cnd
    <youn> Working on today:
    <youn> - https://jira.duraspace.org/browse/FCREPO-2369 - backup and import data set that caused error
    <youn> - https://jira.duraspace.org/browse/FCREPO-2438 - finish
    <youn> - look into import verification errors
    <youn> Blockers:
    <youn> - none
    <youn> Correction: - https://jira.duraspace.org/browse/FCREPO-2369 - restore and export data set that caused error

    <coblej> [Import/Export Standup]
    <coblej> Finished yesterday:
    <coblej> Verified installation of applications / tools.
    <coblej> Working on today:
    <coblej> Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
    <coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2450
    <coblej> Blockers:
    <coblej> None

    <escowles> [Import/Export Standup]
    <escowles> Yesterday:
    <escowles> * Updated PR for overwriting tombstones: https://github.com/fcrepo4-labs/fcrepo-import-export/pull/76
    <escowles> * Worked on support for changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
    <escowles> Today:
    <escowles> * Continue working on changing repository baseURL
    <escowles> * Meetings
    <escowles> Blockers:
    <escowles> * None

    <mikeAtUVa> [Import/Export Standup]
    <mikeAtUVa> Finished yesterday:
    <mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2432
    <mikeAtUVa> - rolled back changes (in my work) that simplified PUT semantics
    <mikeAtUVa> - identified additional work necessary to use existing "minimal" triples requests
    <mikeAtUVa> - learned some more about how binary properties are stored, devised strategy for updating previously server-managed properties for binaries
    <mikeAtUVa> Working on today:
    <mikeAtUVa> - Hope to finish up https://jira.duraspace.org/browse/FCREPO-2432
    <mikeAtUVa> Blockers:
    <mikeAtUVa> - None

    <awoods> [Import/Export Standup]
    <awoods> Finished yesterday:
    <awoods> - Completed: "import tool looks for sha1 manifest file with capitalized filename" : https://jira.duraspace.org/browse/FCREPO-2443
    <awoods> - Reviewed: "Add ability to delete or overwrite tombstone on import" : https://jira.duraspace.org/browse/FCREPO-2202
    <awoods> - Reviewed / Merged: "Semantic differences between exports" : https://jira.duraspace.org/browse/FCREPO-2429
    <awoods> Working on today:
    <awoods> - Reviewing any tickets that are completed
    <awoods> Blockers:
    <awoods> - None


    Expand
    titleStand-up report - 2017-05-18

    <dbernstein> [Import/Export Standup]
    <dbernstein> Finished yesterday:
    <dbernstein> * https://jira.duraspace.org/browse/FCREPO-2451
    <dbernstein> (Break up verify.py into smaller more focused modules.)
    <dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
    <dbernstein> (provide full DEBUG-level logging for import-export verification tool)
    <dbernstein>
    <dbernstein> Working on today:
    <dbernstein>
    <dbernstein> * https://jira.duraspace.org/browse/FCREPO-2408
    <dbernstein> (make verification tool work with BagIt Bags)

    <lsitu> [Import/Export Standup]
    <lsitu> Finished yesterday:
    <lsitu> Add support for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
    <lsitu> Working on today:
    <lsitu> Update PR for Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-2428
    <lsitu> Blockers:
    <lsitu> N/A

    <coblej> [Import/Export Standup]
    <coblej> Finished yesterday:
    <coblej> Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
    <coblej> Working on today:
    <coblej> Attempting to replicate verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369
    <coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2450
    <coblej> Blockers:
    <coblej> None

    <mikeAtUVa> [import/export standup]
    <mikeAtUVa> Yesterday
    <mikeAtUVa> * issued a PR for the server-managed-triples changes to fcrepo
    <mikeAtUVa> * chatted with benpennell about versions
    <mikeAtUVa> Today
    <mikeAtUVa> * addressing reviewer comments for https://github.com/fcrepo4/fcrepo4/pull/1193
    <mikeAtUVa> * identifying/completing changes necessary to import tooling
    <mikeAtUVa> Blockers
    <mikeAtUVa> None

    <youn> [Import/Export Standup]
    <youn> Finished yesterday:
    <youn> - https://jira.duraspace.org/browse/FCREPO-2438 - in review
    <youn> Working on today:
    <youn> - https://jira.duraspace.org/browse/FCREPO-2369 - restore and export data set that caused Unicode errors; look into errors
    <youn> Blockers:
    <youn> - none

    <escowles_> [Import/Export Standup]
    <escowles_> Yesterday:
    <escowles_> * Support for changing repository baseURL https://github.com/fcrepo4-labs/fcrepo-import-export/pull/81
    <escowles_> Today:
    <escowles_> * Started looking at re-enabling support for user-supplied namespace prefixes https://jira.duraspace.org/browse/FCREPO-2376
    <escowles_> * Reviewing PR for allowing server-managed triples https://github.com/fcrepo4/fcrepo4/pull/1193
    <escowles_> Blockers:
    <escowles_> * None

    <benpennell> Finished yesterday:
    <benpennell> * Created ticket for export naming convention collisions https://jira.duraspace.org/browse/FCREPO-2452
    <benpennell> * Discussed a proposed structure for exported versions with mikeAtUVa
    <benpennell> Working on today:
    <benpennell> * Make revisions to versioning proposal and share it for feedback
    <benpennell> * Create tickets for export of versions, begin work if practical
    <benpennell> * Check about previous work on version exporting (umgrosscol?)
    <benpennell> Blockers:
    <benpennell> * Need feedback on questions related to requirements/issues with exporting versions before proceeding

    <awoods> [Import/Export Standup]
    <awoods> Finished yesterday:
    <awoods> - Reviewed: "Re-import of hierarchy" : https://jira.duraspace.org/browse/FCREPO-2428
    <awoods> - Reviewed: "Optionally Update Server Managed Triples" : https://jira.duraspace.org/browse/FCREPO-2432
    <awoods> - Reviewed: "Support changing repository baseURL" : https://jira.duraspace.org/browse/FCREPO-2335
    <awoods> - Reviewed / Merged: "Add ability to delete or overwrite tombstone on import" : https://jira.duraspace.org/browse/FCREPO-2202
    <awoods> - Reviewed / Merged: "Import/Export: Logging documentation" : https://jira.duraspace.org/browse/FCREPO-2425
    <awoods> Working on today:
    <awoods> - Reviewing any tickets that are completed
    <awoods> Blockers:
    <awoods> - None

    <westgard> [Import/Export Standup]
    <westgard> Finished yesterday:
    <westgard> revised https://github.com/fcrepo4-labs/fcrepo-import-export-verify/pull/23
    <westgard> created new tickets for handling of edge cases and errors in verification
    <westgard> Working on today:
    <westgard> continue testing for cause of https://jira.duraspace.org/browse/FCREPO-2369
    <westgard> finish review of https://jira.duraspace.org/browse/FCREPO-2448
    <westgard> Blockers:
    <westgard> None


    Expand
    titleStand-up report - 2017-05-19

    <coblej> youn: about to try it so we'll see ... will let you know
    <coblej> [Import/Export Standup]
    <coblej> Finished yesterday:
    <coblej> Verified that verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369 does not appear to apply to exports from Fedora 4.7.2.
    <coblej> Working on today:
    <coblej> Attempt to replicate verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369 with exports from Fedora 4.6.0. Consult with westgard and youn on remaining work to be done on that issue (if any).
    <coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2450
    <coblej> Blockers:
    <coblej> None

    <youn> [Import/Export Standup]
    <youn> Finished yesterday:
    <youn> - https://jira.duraspace.org/browse/FCREPO-2438: Document use of CND for namespaces: closed
    <youn> - https://jira.duraspace.org/browse/FCREPO-2369: Import-export verification tool's rdf comparison fails on unicode-escaped characters: restored, exported, and verified resources from 4.7.2 repository without any verification failures
    <youn> Working on today:
    <youn> - follow up on FCREPO-2369; possibly, version issues, as noted on ticket
    <youn> - familiarize myself with bag export and with bagit-python
    <youn> Blockers:
    <youn> - none

    <escowles> [Import/Export Standup]
    <escowles> Yesterday:
    <escowles> * Finished support for changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
    <escowles> Today:
    <escowles> * User-supplied namespace prefixes https://jira.duraspace.org/browse/FCREPO-2376
    <escowles> * Export collections based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
    <escowles> Blockers:
    <escowles> * None

    <benpennell> Finished yesterday:
    <benpennell> * Initial proposal for version export plan in https://jira.duraspace.org/browse/FCREPO-2446
    <benpennell> Working on today:
    <benpennell> * Implementation of version export for

    Expand
    titleStand-up report - 2017-05-16

     

    <escowles> [Import/Export standup]
    <escowles> Finished yesterday:
    <escowles> * Adding option to overwrite tombstones on import https://jira.duraspace.org/browse/FCREPO-2202
    <escowles> * Suppressing duplicate RDF types on re-import https://jira.duraspace.org/browse/FCREPO-2429
    <escowles> Today:
    <escowles> * Responding to code review comments
    <escowles> * Support changing repository baseURL 2458
    <benpennell> * Revisions to version export structure as needed
    <benpennell> Blockers:
    <benpennell> * None

    <awoods> [Import/Export Standup]
    <awoods> Finished yesterday:
    <awoods> - Reviewed tickets
    <awoods> Working on today:
    <awoods> - Reviewing tickets
    <awoods> - Please let me know if you have any tickets whose review you would like to be prioritized
    <awoods> Blockers:
    <awoods> - None

    <westgard> [Import/Export Standup]
    <westgard> Finished yesterday:
    <westgard> Reviewed PRs for
    <westgard> https://jira.duraspace.org/browse/FCREPO-2335
    <escowles> Blockers:
    <escowles> * None<awoods> [Import/Export Standup]
    <awoods> Finished yesterday:
    <awoods> - Created and assigned several tickets based on Sprint Kickoff meeting: -2448 (Add python project setup scaffolding for fcrepo-import-export-verify),
    <westgard> https://wikijira.duraspace.org/display/FF/2017-05+Import+-+Export+Sprint+04+Meetings
    <awoods> - Reviewed Adding option to overwrite tombstones on import browse/FCREPO-2368 (provide full DEBUG-level logging for import-export verification tool), and
    <westgard> https://jira.duraspace.org/browse/FCREPO-2202
    <awoods> Working on today:
    <awoods> - Reviewing any tickets that are completed
    <awoods> - Working "import tool looks for sha1 manifest file with capitalized filename" :
    <awoods> 2451 (Break up verify.py into smaller more focused modules)
    <westgard> Continued troubleshooting https://jira.duraspace.org/browse/FCREPO-2443
    <awoods> Blockers:
    <awoods> - None<youn> [Import/Export Standup]
    <youn> Finished yesterday:
    <youn> - Ran export and import using one-click jar and 10KIndirectContainers
    <youn> - Attempted to run verify.py
    <youn> Working on today:
    <youn> - Run verify.py
    <youn> - FCREPO-2369: verify.py fails on unicode-escaped characters; attempt to replicate error
    <youn> - FCREPO-2438: document use of CND for namespaces; attempt to apply fix
    <youn> - Will be offline in the afternoon for meetings, etc.
    <youn> Blockers:
    <youn> - urllib module in verify.py?2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
    <westgard> Working on today:
    <westgard> Try to get to resolution on https://jira.duraspace.org/browse/FCREPO-2469;
    <westgard> https://jira.duraspace.org/browse/FCREPO-2460 (update readme (help text) and inline comments in newly refactored codebase);
    <westgard> Attempt again to reproduce https://jira.duraspace.org/browse/FCREPO-2462 (verification tool gives random incorrect responses) and resolve if not possible.
    <westgard> Blockers:
    <westgard> None.

    <mikeAtUVa> [Import/Export Standupstandup]
    <mikeAtUVa> Finished yesterday:
    <mikeAtUVa> Spoke breifly with benpennell to strategize
    <mikeAtUVa> Working on today:
    <mikeAtUVa> Yesterday
    <mikeAtUVa> * addressed comments, improved https://jira.duraspace.org/browse/FCREPO-2432 (relaxed server managed triples)
    <mikeAtUVa> * started settinng up environment to work on https://jira.duraspace.org/browse/FCREPO-2461 (add support for roundtripping of server managed triples)
    <mikeAtUVa> Today:
    <mikeAtUVa> * https://jira.duraspace.org/browse/FCREPO-2432 adding support to update certain server-managed triples
    <mikeAtUVa> - replace code that simplifies PUT interactions to use existing "handling-lenient, received-minimal" pattern
    <mikeAtUVa> - attempt to implement intuitive date updates adding children with provided creation dates
    <mikeAtUVa> - add test cases for binaries and ensure that they work
    <mikeAtUVa> - address test failure on travis (didn't appear locally) : https://travis-ci.org/fcrepo4/fcrepo4/builds/232586336?utm_source=github_status&utm_medium=notification
    <mikeAtUVa> - determine the interaction of forced modification dates with etags and their implications on caching and if-modified headers
    <mikeAtUVa> Blockers:
    <mikeAtUVa> - none2461
    <mikeAtUVa> Blockers:
    <mikeAtUVa> * None

    <dbernstein> [Import/Export Standup]
    <dbernstein> Finished yesterday:
    <dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
    <dbernstein> (retool logging for import-export verification tool)
    <dbernstein> More improvements - feature branch rebased with master and pull request is in.
    <dbernstein>
    <dbernstein> Working on today:
    <dbernstein> * <benpennell> Finished yesterday:
    <benpennell> * environment setup
    <benpennell> * read through Mike's work on https://jira.duraspace.org/browse/FCREPO-2432
    <benpennell> Working on today:
    <benpennell> * familiarize myself with import/export codebase.
    <benpennell> * familiarize myself with current and new versioning specifications, the challenges involved.
    <benpennell> * strategize about how to represent versions
    <benpennell> * work towards generating some tickets with Mike.
    <benpennell> Blockers:
    <benpennell> * is there previous work/discussion about exporting versions to reference?2408
    <dbernstein> (make verification tool work with BagIt Bags)
    <dbernstein>
    <dbernstein> Blockers:
    <dbernstein> None.


    Expand
    titleStand-up report - 2017-05-22

    <coblej> <westgard> [Import/Export Standup]
    <westgard> <coblej> Finished yesterday:
    <westgard> re-familiarized myself with code and tickets
    <westgard> consulted with dbernstein regarding logging behavior ticket (FCREPO-2368)
    <westgard> identified test data that demonstrates bug in unicode escaping (FCREPO-2369)
    <westgard> Working on today:
    <westgard> FCREPO-2303 (verify triples)
    <westgard> FCREPO-2329 (handle missing resources during verification)
    <westgard> Blockers:
    <westgard> More feedback from stakeholders regarding desired logging behavior & command line options would be helpful (relates to FCREPO-2368)<coblej> Replicated verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369 with exports from Fedora 4.6.0.
    <coblej> Working on today:
    <coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-2455
    <coblej> Blockers:
    <coblej> None

    <mikeAtUVa> [import/export standup]
    <mikeAtUVa> Finished last Friday:
    <mikeAtUVa> - last modifications and changes to https://github.com/fcrepo4/fcrepo4/pull/1193 (relaxed server managed triples)
    <mikeAtUVa> Today:
    <mikeAtUVa> - mostly unrelated meetings
    <mikeAtUVa> - <coblej>
    Finished yesterday:
      Installed applications / tools for import export testing on workstation.
    Working on today:
    Verifying installation of applications / tools.
    Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
    Blockers:
    Cannot load “main” sample datasets into one-click run Fedora 4.7.2.  “mvn -Dfcrepo.url=http://localhost:8080/rest/ exec:java” command results in “ERROR 08:29:39.119 (FedoraInvalidNamespaceExceptionMapper) NamespaceExceptionMapper caught an exception: Prefix fcr has not been registered” for each dataset.  (Loading the “additional datasets” via fcr:restore seems to work fine.)

    Expand
    titleStand-up report - 2017-05-17

    2464 (documenting relaxed server managed triples)
    <mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2461 (updating importer to support relaxed server managed triples)
    <mikeAtUVa> Blockers:
    <mikeAtUVa> - probably can't fully finish the importer updates without a version of 4.7.4 available for download for integration tests

    <escowles> [Import/Export Standup]
    <escowles> Last Friday:
    <escowles> * Debugged parallel build failures https://jira.duraspace.org/browse/FCREPO-2466
    <escowles> Today:
    <escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
    <escowles> Blockers:
    <escowles> * None

    <benpennell> Finished yesterday:
    <benpennell> * Second proposal for structure of version exports for <lsitu> [Import/Export Standup]
    <lsitu> Finished yesterday:
    <lsitu> Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-24282446
    <lsitu> <benpennell> Working on today:
    <lsitu> Add support for round-tripping with binaries excluded: <benpennell> * Finish up implementation and unit tests for version export, create PR https://jira.duraspace.org/browse/FCREPO-2426
    <lsitu> Blockers:
    <lsitu> N/A.-2458
    <benpennell> * Start thinking about implementation of versions importing
    <benpennell> Blockers:
    <benpennell> * none

    <awoods> [Import/Export Standup]
    <awoods> Finished last Friday:
    <awoods> - Reviewed tickets
    <awoods> Working on today:
    <awoods> - Reviewing tickets
    <awoods> Blockers:
    <awoods> - None

    <lsitu> <dbernstein> [Import/Export Standup]
    <dbernstein> <lsitu> Finished yesterdaylast Friday:
    <dbernstein> <lsitu> Rebase PR and refactor codes to fix conflicts for Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-2448
    <dbernstein> * Added setup.py to verify tool and setup up support for adding unit tests
    <dbernstein> * Did some minor refactoring of command line parser using ‘click’ module
    <dbernstein> * Add support for installing verify (now fcrepo-verify) on the path.
    <dbernstein> * Pull request is in.
    <dbernstein>
    <dbernstein> Working on today:
    <dbernstein>
    <dbernstein> * 2428
    <lsitu> Updated PR for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
    <lsitu> Working on today:
    <lsitu> Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2368
    <dbernstein> (provide full DEBUG-level logging for import-export verification tool)
    <dbernstein> Blockers:
    <dbernstein> None.<bridgetalmas> [Import/Export Standup] Working on today:   Verify Perseids BagIt Profile  2418
    <lsitu> Imporve PR for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2440 Blockers:   Mapping to LDP model   Import of tag manifest contents (2426
    <lsitu> Blockers:
    <lsitu> None

    <youn> [Import/Export Standup]
    <youn> Finished yesterday:
    <youn> - https://jira.duraspace.org/browse/FCREPO-2444)<youn> /browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters) - added note on Unicode errors to README
    <youn> - tested bag export and verification with bagit-python
    <youn> Working on today:
    <youn> - follow up on comments on FCREPO-2369
    <youn> - get feedback on (and work on) ideas for videos
    <youn> Blockers:
    <youn> - none

    <westgard> [Import/Export Standup]
    <youn> <westgard> Finished yesterdayFriday:
    <youn> - Ran verify.py to verify export of 10KIndirectContainers; attempted to verify import but stopped when I ran into lots of verification errors
    <youn> - Started repository with modified repository.json and namespaces.cnd
    <youn> Working on today:
    <youn> - <westgard> https://jira.duraspace.org/browse/FCREPO-2460 (update readme (help text) and inline comments in newly refactored codebase)
    <westgard> https://jira.duraspace.org/browse/FCREPO-2369 - backup and import data set that caused error
    <youn> - 2463 (minor formatting fixes in verification tool)
    <westgard> Continued troubleshooting of https://jira.duraspace.org/browse/FCREPO-2438 - finish
    <youn> - look into import verification errors
    <youn> Blockers:
    <youn> - none
    <youn> Correction: - 2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
    <westgard> Working on today:
    <westgard> https://jira.duraspace.org/browse/FCREPO-2457 (handle failed connection gracefully)
    <westgard> Continued troubleshooting of https://jira.duraspace.org/browse/FCREPO-2369 (Import- restore and export data set that caused errorexport verification tool's rdf comparison fails on unicode-escaped characters)
    <westgard> Blockers:
    <westgard> None.

    <dbernstein> <coblej> [Import/Export Standup]
    <coblej> <dbernstein> Finished yesterday:
    <coblej> Verified installation of applications / tools.
    <coblej> Working on today:
    <coblej> Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
    <coblej> Testing with subset of production-like Duke data: <dbernstein> * Nothing finished (out most of the day)
    <dbernstein> Working on today:
    <dbernstein> * https://jira.duraspace.org/browse/FCREPO-2450
    <coblej> 2408
    <dbernstein> (make verification tool work with BagIt Bags)
    <dbernstein> Blockers:
    <coblej> None<escowles> <dbernstein> None.



    Expand
    titleStand-up report - 2017-05-23

    <youn> [Import/Export Standup]
    <escowles> Yesterday:
    <escowles> * Updated PR for overwriting tombstones: https://github.com/fcrepo4-labs/fcrepo-import-export/pull/76
    <escowles> * Worked on support for changing repository baseURL <youn> Finished yesterday:
    <youn> - https://jira.duraspace.org/browse/FCREPO-2335
    <escowles> Today:
    <escowles> * Continue working on changing repository baseURL
    <escowles> * Meetings
    <escowles> Blockers:
    <escowles> * None-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters) - used sample RDF containing Unicode to test the verification tool with the one click for 4.6.0 and 4.7.3-RC
    <youn> - started proposal for videos
    <youn> Working on today:
    <youn> - finish proposal for videos
    <youn> Blockers:
    <youn> - none

    westgard> <mikeAtUVa> [Import/Export Standup]
    <mikeAtUVa> Finished yesterday:
    <mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2432
    <mikeAtUVa> - rolled back changes (in my work) that simplified PUT semantics
    <mikeAtUVa> - identified additional work necessary to use existing "minimal" triples requests
    <mikeAtUVa> - learned some more about how binary properties are stored, devised strategy for updating previously server-managed properties for binaries
    <mikeAtUVa> Working on today:
    <mikeAtUVa> - Hope to finish up <westgard> Finished yesterday:
    <westgard> started https://jira.duraspace.org/browse/FCREPO-2432
    <mikeAtUVa> 2457 (handle failed connection gracefully)
    <westgard> Working on today:
    <westgard> finish FCREPO-2457
    <westgard> Blockers:
    <mikeAtUVa> - <westgard> None.

    <awoods> <coblej> [Import/Export Standup]
    <awoods> <coblej> Finished yesterday:
    <awoods> - Completed: "import tool looks for sha1 manifest file with capitalized filename" : https://jira.duraspace.org/browse/FCREPO-2443
    <awoods> - Reviewed: "Add ability to delete or overwrite tombstone on import" : <coblej> Working on today:
    <coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-22022455
    <coblej> Blockers:
    <coblej> None

    <awoods> [Import/Export Standup]
    <awoods> Finished last Friday:
    <awoods> - Reviewed / Merged: "Semantic differences between exports" : tickets
    <awoods> Working on today:
    <awoods> - Reviewing tickets
    <awoods> Blockers:
    <awoods> - None

    <mikeAtUVa> [import/export sprint standup]
    <mikeAtUVa> Yesterday:
    <mikeAtUVa> - mostly worked on urelated things
    <mikeAtUVa> Today:
    <mikeAtUVa> - Finish up https://jira.duraspace.org/browse/FCREPO-2429
    <awoods> Working on today:
    <awoods> - Reviewing any tickets that are completed
    <awoods> Blockers:
    <awoods> - None

    Expand
    titleStand-up report - 2017-05-18

    -2461
    <mikeAtUVa> - Determine if more changes to fcrepo are in order (for versioning) in the scope of this sprint
    <mikeAtUVa> Blockers:
    <mikeAtUVa> - none

    <escowles> <dbernstein> [Import/Export Standup]
    <dbernstein> Finished yesterday<escowles> Yesterday:
    <dbernstein> * <escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2451
    <dbernstein> (Break up verify.py into smaller more focused modules.)
    <dbernstein> * 2453
    <escowles> * Fix Bag import using config file https://jira.duraspace.org/browse/FCREPO-2368
    <dbernstein> (provide full DEBUG-level logging for import-export verification tool)
    <dbernstein>
    <dbernstein> Working on today:
    <dbernstein>
    <dbernstein> * https://jira.duraspace.org/browse/FCREPO-2408
    <dbernstein> (make verification tool work with BagIt Bags)2462
    <escowles> Today:
    <escowles> * Rebase PR #84 (exporting members based on inbound links)
    <escowles> * Not sure after that: whatever needs help
    <escowles> Blockers:
    <escowles> * None

    <benpennell> <lsitu> [Import/Export Standup]
    <lsitu> <benpennell> Finished yesterday:
    <lsitu> Add support for round-tripping with binaries excluded: :
    <benpennell> * Create PR for export of versions https://jira.duraspace.org/browse/FCREPO-24262458
    <lsitu> <benpennell> Working on today:
    <lsitu> Update PR for Re-import of hierarchy: <benpennell> * Planning and implementation of version import https://jira.duraspace.org/browse/FCREPO-24282459
    <benpennell> * Some local stuff
    <benpennell> Blockers:
    <benpennell> * none

    <lsitu>
    <lsitu> Blockers:
    <lsitu> N/A<coblej> [Import/Export Standup]
    <coblej> <lsitu> Finished yesterday:
    <coblej> Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
    <coblej> Working on today:
    <coblej> Attempting to replicate verification tool Unicode-escaped characters failure reported in <lsitu> Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2369
    <coblej> Testing with subset of production-like Duke data2418
    <lsitu> Consolidate the findRepositoryRoot method for PR with round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2450
    <coblej> Blockers:
    <coblej> None2426
    <lsitu> Working on today:
    <lsitu> Improve Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2418?
    <lsitu> Will find more tickets.
    <lsitu> Blockers:
    <lsitu> None


    Expand
    titleStand-up report - 2017-05-24

    <coblej>

    <mikeAtUVa> [import/export standup]
    <mikeAtUVa> Yesterday
    <mikeAtUVa> * issued a PR for the server-managed-triples changes to fcrepo
    <mikeAtUVa> * chatted with benpennell about versions
    <mikeAtUVa> Today
    <mikeAtUVa> * addressing reviewer comments for https://github.com/fcrepo4/fcrepo4/pull/1193
    <mikeAtUVa> * identifying/completing changes necessary to import tooling
    <mikeAtUVa> Blockers
    <mikeAtUVa> None

    <youn> [Import/Export Standup]
    <youn> <coblej> Finished yesterday:
    <youn> - <coblej> Working on today:
    <coblej> Testing sprint changes using interim code releases
    <coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-2438 - in review
    <youn> Working on today:
    <youn> - 2455
    <coblej> Blockers:
    <coblej> None

    <awoods> Import/Export Standup]
    <awoods> Finished yesterday:
    <awoods> - Reviewed tickets
    <awoods> - Created testing recipes (please everyone do at least one unique test): https://jirawiki.duraspace.org/display/browseFF/FCREPO-2369 - restore and export data set that caused Unicode errors; look into errors
    <youn> Blockers:
    <youn> - none<escowles_> [Import/Export Standup]
    <escowles_> Yesterday:
    <escowles_> * Support for changing repository baseURL https://github.com/fcrepo4-labs/fcrepo-import-export/pull/81
    <escowles_> Today:
    <escowles_> * Started looking at re-enabling support for user-supplied namespace prefixes Import+-+Export+Testing+Recipes
    <awoods> - Uploaded recent versions of import/export utility and Fedora-master: https://wiki.duraspace.org/display/FF/2017-05+Import+-+Export+Sprint+04+Meetings#id-2017-05Import-ExportSprint04Meetings-Resources
    <awoods> - Created ticket for testing import into Cavendish: https://jira.duraspace.org/browse/FCREPO-2376
    <escowles_> * Reviewing PR for allowing server-managed triples https://github.com/fcrepo4/fcrepo4/pull/1193
    <escowles_> Blockers:
    <escowles_> * None<benpennell> Finished yesterday:
    <benpennell> * Created ticket for export naming convention collisions 2476
    <awoods> Working on today:
    <awoods> - Reviewing tickets
    <awoods> Blockers:
    <awoods> - Waiting on resolution to: new bug "import-export does not respect containment predicates when pointed at rest/" (https://jira.duraspace.org/browse/FCREPO-24522474)

    <mikeAtUVa> [import/export sprint standup]
    <mikeAtUVa> Yesterday:
    <mikeAtUVa> - https://github.com/fcrepo4-labs/fcrepo-import-export/pull/88 updated importer to support lossless roundtripping of RDF
    <mikeAtUVa> Today:
    <mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2464 (document "relaxed" triples mode)
    <mikeAtUVa> - I'll take a look at https://github.com/fcrepo4-labs/fcrepo-import-export/pull/85 if it's not already reviewed/merged
    <mikeAtUVa> - Look into aligning versioning with spec, providing feedback where necessary
    <mikeAtUVa> Blockers:
    <mikeAtUVa> - none

    <youn>
    <benpennell> * Discussed a proposed structure for exported versions with mikeAtUVa
    <benpennell> Working on today:
    <benpennell> * Make revisions to versioning proposal and share it for feedback
    <benpennell> * Create tickets for export of versions, begin work if practical
    <benpennell> * Check about previous work on version exporting (umgrosscol?)
    <benpennell> Blockers:
    <benpennell> * Need feedback on questions related to requirements/issues with exporting versions before proceeding<awoods> [Import/Export Standup]
    <awoods> <youn> Finished yesterday:
    <awoods> - Reviewed: "Re-import of hierarchy" : https://jira.duraspace.org/browse/FCREPO-2428
    <awoods> - Reviewed: "Optionally Update Server Managed Triples" : https://jira.duraspace.org/browse/FCREPO-2432
    <awoods> - Reviewed: "Support changing repository baseURL" : <youn> - draft proposal for videos and ***WELCOME YOUR FEEDBACK*** https://jiradocs.duraspace.org/browse/FCREPO-2335
    <awoods> - Reviewed / Merged: "Add ability to delete or overwrite tombstone on import" : https://jira.duraspace.org/browse/FCREPO-2202
    <awoods> - Reviewed / Merged: "Import/Export: Logging documentation" : google.com/document/d/1CzvJlZ3m3eEhHgVJJY0hdGerPMxRIRaK9X05WhCLKpo/edit?usp=sharing
    <youn> Working on today:
    <youn> - test bag import export and version import export
    <youn> - test predicates and inbound with lubm
    <youn> - https://jira.duraspace.org/browse/FCREPO-24252473 (verification tool should handle import-export v1.1 config files)
    <youn> Blockers:
    <youn> - none

    <lsitu>
    <awoods> Working on today:
    <awoods> - Reviewing any tickets that are completed
    <awoods> Blockers:
    <awoods> - None<westgard> [Import/Export Standup]
    <westgard> Finished yesterday:
    <westgard> revised https://github.com/fcrepo4-labs/fcrepo-import-export-verify/pull/23
    <westgard> created new tickets for handling of edge cases and errors in verification
    <westgard> Working on today:
    <westgard> continue testing for cause of https://jira.duraspace.org/browse/FCREPO-2369
    <westgard> finish review of
    <lsitu> Finished yesterday:
    <lsitu> Improved and rebased the PR for Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2448
    <westgard> Blockers:
    <westgard> None

    Expand
    titleStand-up report - 2017-05-19

    2418
    <lsitu> Working on today:
    <lsitu> Not sure: can help on anything else.
    <lsitu> Blockers:
    <lsitu> None

    <escowles> <coblej> youn: about to try it so we'll see ... will let you know
    <coblej> [Import/Export Standup]
    <coblej> Finished yesterday:
    <coblej> Verified that verification tool Unicode-escaped characters failure reported in <escowles> Yesterday:
    <escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
    <escowles> * Fix Bag import using config file https://jira.duraspace.org/browse/FCREPO-2369 does not appear to apply to exports from Fedora 4.7.2.
    <coblej> Working on today:
    <coblej> Attempt to replicate verification tool Unicode-escaped characters failure reported in 2462
    <escowles> Today:
    <escowles> * Trailing slash issues https://jira.duraspace.org/browse/FCREPO-2467
    <escowles> * Containment predicates don't work when pointed at /rest https://jira.duraspace.org/browse/FCREPO-2369 with exports from Fedora 4.6.0. Consult with westgard and youn on remaining work to be done on that issue (if any).
    <coblej> Testing with subset of production-like Duke data: 2474
    <escowles> * Squashing bugs from testing
    <escowles> Blockers:
    <escowles> * None

    <benpennell> [Import/Export Standup]
    <benpennell> Finished yesterday:
    <benpennell> * A bunch of local stuff
    <benpennell> * Some decisions about requirements for import of versions related to timestamps
    <benpennell> Working on today:
    <benpennell> * Implementation of version import https://jira.duraspace.org/browse/FCREPO-24502459
    <coblej> <benpennell> Blockers:
    <benpennell> * none

    <westgardj> <coblej> None<youn> [Import/Export Standup]
    <youn> <westgardj> Finished yesterday:
    <youn> - <westgardj>   Finished https://jira.duraspace.org/browse/FCREPO-2438: Document use of CND for namespaces: closed
    <youn> - 2457 (handle failed connection gracefully)
    <westgardj>   Tested current master branch of import-export tool
    <westgardj> Working on today:
    <westgardj>   https://jira.duraspace.org/browse/FCREPO-2369: Import-export verification tool's rdf comparison fails on unicode-escaped characters: restored, exported, and verified resources from 4.7.2 repository without any verification failures
    <youn> Working on today:
    <youn> - follow up on FCREPO-2369; possibly, version issues, as noted on ticket
    <youn> - familiarize myself with bag export and with bagit-python2449
    <westgardj>   Additional testing of import-export and verifier
    <westgardj> Blockers:
    <westgardj>   None.

    <dbernstein>
    <youn> Blockers:
    <youn> - none<escowles> [Import/Export Standup]
    <escowles> Yesterday<dbernstein> Finished yesterday:
    <escowles> * Finished support for changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
    <escowles> Today:
    <escowles> * User-supplied namespace prefixes <dbernstein> *
    <dbernstein> Working on today:
    <dbernstein> * finishing up https://jira.duraspace.org/browse/FCREPO-2376
    <escowles> * Export collections based on inbound links 2408
    <dbernstein> (make verification tool work with BagIt Bags)this morning
    <dbernstein> * https://jira.duraspace.org/browse/FCREPO-2453
    <escowles> -2475
    <dbernstein> (verifcation tool should log to timestamped log files)
    <dbernstein>
    <dbernstein> Blockers:
    <escowles> * <dbernstein> None<benpennell> .


    Expand
    titleStand-up report - 2017-05-25

    <coblej> [Import/Export Standup]
    <coblej> Finished yesterday:
    <benpennell> * Initial proposal for version export plan in <coblej> Document export format in partial response to https://jira.duraspace.org/browse/FCREPO-2446
    <benpennell> 2455 (Import/Export: Document import structural expectations)
    <coblej> Working on today:
    <benpennell> * Implementation of version export for https://jira.duraspace.org/browse/FCREPO-2458
    <benpennell> * Revisions to version export structure as needed
    <benpennell> Blockers:
    <benpennell> * None<awoods> <coblej> Testing sprint changes using interim code releases
    <coblej> Blockers:
    <coblej> None

    <youn> [Import/Export Standup]
    <awoods> <youn> Finished yesterday:
    <awoods> - Reviewed tickets
    <awoods> Working on today:
    <awoods> - Reviewing tickets
    <awoods> - Please let me know if you have any tickets whose review you would like to be prioritized
    <awoods> Blockers:
    <awoods> - None<youn> - tested export with lubm
    <youn> - regenerated lubm backup, replacing link for external content; https://yale.box.com/s/0rkv4q1akg7g1w3oq4zhnrkafeppmplg needs to be added to github repo; previous versions should be deleted
    <youn> Working on today:
    <youn> - test lubm import and verify export and import
    <youn> - test versions and bags
    <youn> - https://jira.duraspace.org/browse/FCREPO-2473 (verification tool should handle import-export v1.1 config files)
    <youn> Blockers:
    <youn> - none

    <escowles> <westgard> [Import/Export Standup]
    <westgard> Finished yesterday:
    <westgard> Reviewed PRs for
    <westgard> <escowles> Yesterday:
    <escowles> * Trailing slash issues https://jira.duraspace.org/browse/FCREPO-2467
    <escowles> * Containment predicates don't work when pointed at /rest https://jira.duraspace.org/browse/FCREPO-2448 (Add python project setup scaffolding for fcrepo-import-export-verify),
    <westgard> 2474
    <escowles> * Test import into Cavendish https://jira.duraspace.org/browse/FCREPO-2368 (provide full DEBUG-level logging for import-export verification tool), and
    <westgard> 2476
    <escowles> Today:
    <escowles> * findRepositoryRoot should have a sensible fallback https://jira.duraspace.org/browse/FCREPO-2451 (Break up verify.py into smaller more focused modules)
    <westgard> Continued troubleshooting 2477
    <escowles> * Error importing export with inbound references https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
    <westgard> Working on today:
    <westgard> Try to get to resolution on 2483
    <escowles> * Squashing bugs from testing
    <escowles> * Couple meetings
    <escowles> Blockers:
    <escowles> * None

    <awoods> Import/Export Standup]
    <awoods> Finished yesterday:
    <awoods> - Reviewed tickets
    <awoods> Working on today:
    <awoods> - Reviewing tickets
    <awoods> Blockers:
    <awoods> - None

    <mikeAtUVa> [import/export sprint standup]
    <mikeAtUVa> Finished Yesterday:
    <mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2469;
    <westgard> 2464 documented "relaxed" triple mode
    <mikeAtUVa> Working on Today:
    <mikeAtUVa> - testing scenarios
    <mikeAtUVa> - comments for https://jiragithub.duraspace.org/browse/FCREPO-2460 (update readme (help text) and inline comments in newly refactored codebase);
    <westgard> Attempt again to reproduce com/fcrepo4-labs/fcrepo-import-export/pull/88
    <mikeAtUVa> Blockers:
    <mikeAtUVa> none

    <benpennell> [Import/Export Standup]
    <benpennell> Finished yesterday:
    <benpennell> * Created ticket for issue with generated relations in versions https://jira.duraspace.org/browse/FCREPO-2462 (verification tool gives random incorrect responses) and resolve if not possible.
    <westgard> Blockers:
    <westgard> None.

    <mikeAtUVa> [Import/Export standup]
    <mikeAtUVa> Yesterday
    <mikeAtUVa> * addressed comments, improved https://jira.duraspace.org/browse/FCREPO-2432 (relaxed server managed triples)
    <mikeAtUVa> * started settinng up environment to work on https://jira.duraspace.org/browse/FCREPO-2461 (add support for roundtripping of server managed triples)
    <mikeAtUVa> Today:
    <mikeAtUVa> * https://jira.duraspace.org/browse/FCREPO-2461
    <mikeAtUVa> Blockers:
    <mikeAtUVa> * None

    2479
    <benpennell> Working on today:
    <benpennell> * Respond to feedback on version export PR
    <benpennell> * Continue to work on initial implementation of version import ticket
    <benpennell> * Can't guarantee version import will be done by the end of the sprint, it will depend on how smoothly today goes and feedback on the export, but I hope to have a first pass at it
    <benpennell> Blockers
    <benpennell> * none

    <lsitu> [Import/Export Standup]
    <lsitu> Finished yesterday:
    <lsitu> Testing export and import the plant patent dataset (restored from plants.tar.gz) with options -b, -g (default/aptrust), -i, -p, -t, -x in https://wiki.duraspace.org/display/FF/Import+-+Export+Testing+Recipes
    <lsitu> Working on today:
    <lsitu> Use the verification tool to verify import/export.
    <lsitu> Fix bugs that coming up from from testing.
    <lsitu> Blockers:
    <lsitu> It seems that the verification tool works fine for binary export at this time but has limitation on other options. What can we test now?


    Expand
    titleStand-up report - 2017-05-26

    <coblej> <dbernstein> [Import/Export Standup]
    <dbernstein> <coblej> Finished yesterday:
    <dbernstein> * <coblej> Two test scenarios using then-current code, documented at https://jirawiki.duraspace.org/browse/FCREPO-2368
    <dbernstein> (retool logging for import-export verification tool)
    <dbernstein> More improvements - feature branch rebased with master and pull request is in.
    <dbernstein>
    <dbernstein> display/FF/Import+-+Export+Testing+Recipes .
    <coblej> Working on today:
    <dbernstein> * <coblej> Testing sprint changes using interim code releases against subset of production-like Duke data ( https://jira.duraspace.org/browse/FCREPO-2408
    <dbernstein> (make verification tool work with BagIt Bags2450 )
    <dbernstein>
    <dbernstein> <coblej> Blockers:
    <dbernstein> <coblej> None.

    Expand
    titleStand-up report - 2017-05-22

    <youn> <coblej> [Import/Export Standup]
    <coblej> <youn> Finished yesterday:
    <coblej> Replicated verification tool Unicode-escaped characters failure reported in :
    <youn> - tested export with lubm; tried to test import
    <youn> - responded to feedback on https://jira.duraspace.org/browse/FCREPO-2369 with exports from Fedora 4.6.0.
    <coblej> 2299 (Import Export Videos)
    <youn> Working on today:
    <coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-2455
    <coblej> Blockers:
    <coblej> None<mikeAtUVa> [import/export standup]
    <mikeAtUVa> Finished last Friday:
    <mikeAtUVa> - last modifications and changes to https://github.com/fcrepo4/fcrepo4/pull/1193 (relaxed server <youn> - sprint feedback
    <youn> Blockers:
    <youn> - none

    <escowles> [Import/Export Standup]
    <escowles> Yesterday:
    <escowles> * findRepositoryRoot should have a sensible fallback https://jira.duraspace.org/browse/FCREPO-2477
    <escowles> * Error importing export with inbound references https://jira.duraspace.org/browse/FCREPO-2483
    <escowles> * Only writing config file if specified managed triples)
    <mikeAtUVa> Today:
    <mikeAtUVa> - mostly unrelated meetings
    <mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2464 (documenting relaxed server managed triples)
    <mikeAtUVa> - 2430
    <escowles> * Adding If-Modified-Since header to PUT-to-update requests https://jira.duraspace.org/browse/FCREPO-2461 (updating importer to support relaxed server managed triples)
    <mikeAtUVa> Blockers:
    <mikeAtUVa> - probably can't fully finish the importer updates 2498
    <escowles> Today:
    <escowles> * Rebasing PRs and responding to code review
    <escowles> * Available to fix any last-minute bugs
    <escowles> Blockers:
    <escowles> * None

    <lsitu> without a version of 4.7.4 available for download for integration tests<escowles> [Import/Export Standup]
    <escowles> Last Friday:
    <escowles> * Debugged parallel build failures <lsitu> Finished yesterday:
    <lsitu> Improve logging for HTTP exception in export with binary excluded: https://jira.duraspace.org/browse/FCREPO-2466
    <escowles> Today:
    <escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
    <escowles> Blockers:
    <escowles> * None

    <benpennell> Finished yesterday:
    <benpennell> * Second proposal for structure of version exports for https://jira.duraspace.org/browse/FCREPO-2446
    <benpennell> Working on today:
    <benpennell> * Finish up implementation and unit tests for version export, create PR https://jira.duraspace.org/browse/FCREPO-2458
    <benpennell> * Start thinking about implementation of versions importing
    <benpennell> Blockers:
    <benpennell> * none

    2480.
    <lsitu> Tested the the vrification tool and replcate the errors.
    <lsitu> Tested the export/import tool and the vrification tool from master branch with Fedora fcrepo-webapp-4.8.0-SNAPSHOT-jetty-console-a07a1a46: https://wiki.duraspace.org/display/FF/Import+-+Export+Testing+Recipes.
    <lsitu> Working on today:
    <lsitu> Test export/import tool and use the verification tool to verify the result.
    <lsitu> Fix bugs that are coming up from from testing.
    <lsitu> Blockers:
    <lsitu> None

    <awoods> <awoods> [ Import/Export Standup]
    <awoods> Finished last Fridayyesterday:
    <awoods> - Reviewed tickets
    <awoods> Working on today:
    <awoods> - Reviewing tickets
    <awoods> Blockers:
    <awoods> - None