Page tree
Skip to end of metadata
Go to start of metadata

Call in details:


Sprinters


Objectives

The objectives of sprint-03 are to:

  1. Address Phase-1 issues

     All red tickets...

    T Key Summary Assignee Reporter P Status Resolution Created Updated Due
    Loading...
    Refresh

  2. Implement Phase-2 requirements for verification tooling 
  3. Implement Phase-2 requirements

     All red tickets...

    T Key Summary Assignee Reporter P Status Resolution Created Updated Due
    Loading...
    Refresh

  4. Plan the production of a few 3-minute videos that demonstrate import/export functionality

Resources

Design - Import - Export

Meetings

 Meeting 01 - 2016-12-05

Meeting 01 - 2016-12-05

  • 11am ET

Agenda

  1. Introductions
  2. Logistics
    1. Virtual daily stand-ups?
    2. IRC? 
    3. Conference calls?
    4. Email check-in?
    5. Sprint retrospective?
  3. Sprint Priorites
  4. Assign work

Minutes

  1. Virtual Stand ups
    1. IRC (freenode - #fcrepo)
    2. Drop IRC template by 10am eastern the next day.
  2. Calls
    1. Wednesday morning meeting: 12/7 12pm Eastern - same line
    2. Wednesday morning meeting: 12/14 12pm Eastern - same line
    3. Friday 12/16 Retrospective Meeting: 2pm Eastern (no Andrew or Danny)
  3. Sprint Priorities
    1. Purpose of the 3 - minute video is to engage the community as well as provide and entry point for people to use the tools
  4. Work Assignment
    1. Justin to create ticket for verifying external binaries
      • Created
    2. Can Kieran and Adam use Scholarsphere data to help test the tooling?
      • Yes. Adam to create the ticket
  5. Note: The import export tooling runs against the API. Backup/Restore runs against Modeshape.
  6. State of the Documentation:
    • Justin to update the import export format documentation; ensuring there are good pointers for getting to the documentation and docs actually are useful for enabling people to use the tool.
    • Justin to review Bag related tickets to make sure they cover what needs covering.
 Meeting 02 - 2016-12-07

Meeting 02 - 2016-12-07

  • 12pm ET

 

  1. https://github.com/fcrepo4-labs/fcrepo-import-export/pull/48

    Should we support mapping repository paths, not just host/port

    Esmé Cowles - This ticket came out of integration test for round tripping, export and import into a different directory. 

    We had some allowance for different hostname ports, but base URI and everything else must be the same. At least the base URI could be modified in case of changed deployment.

    While doing that Hydra already has various sub-directories, so that could be great. But it brings up issues. How do you handle if you export a resource, but not any linked resources.

    Is it a requirement to be able to export a resource/tree of resources and then import it into a different location in a repository. This means we are changing the resource.

    There is more complication, but it would be nice to do it. If we run into unsolvable problems, then we can stop. But baseURI as a minimum. 

    Verification tooling would have to be updated as it not designed to handle this circumstance. If there is a need for this, then we can correct this in the verification tooling. 

    Does this resolve the Phase 1 #6 wish. "Support import into an existing empty container."

    We have been assuming that the container is going to be the same, host/port is a hard one to adjust for, changing base URI in Tomcat is somewhat easier. 

    Don’t want to get sidetracked on this issue and not achieve the sprint goals.

    Base Path is generally “/fcrepo/rest”

    Ingesting in to a Hydra instance under /dev and then after verifying moving it to /prod.

    Esmé Cowles will make a ticket or two and point to pull/48 as a first stab and move onto integration tests.

    Final question “What would we want inter-resource relationships to look like.” when ingesting to a new location. Principle was what would it look like if you exported the entire repository and import the entire repository. We haven’t talk through all the possibilities, it would be good to make sure we agree on this.

     

  2. Validation

    https://github.com/fcrepo4-labs/fcrepo-import-export-verify/pull/7

    Hope the PR is complete, Josh has not tested but feels it is almost there. The latest commit just changed the default logger level.

    Should be able to test the latest version this afternoon and merge.

    It would be great if that issue could be closed, and the config file as changed a bit and that needs to be dealt with.

    Won’t have working tool until the update to deal with new config file options. Should be a quick fix (possibly completed today).

    Still haven’t sorted out the issues around verifying RDF, filtering out server managed triples.

    Can Nick help with verifying PRs or with updating the code to test the config, Nick will take FCREPO-2332 - Getting issue details... STATUS .

    If you exported and then tried to verify against a Fedora instance that might have new objects you will not get any errors. The system is not designed to check both ways. FCREPO-2322 - Getting issue details... STATUS .

    FCREPO-2307 - Getting issue details... STATUS is around verifying a Fedora to another Fedora too.

    FCREPO-2329 - Getting issue details... STATUS this is trying to check something, it finds an error and breaks off. What we want is for it to deal with the error and move on. 

    Next person that runs in the “Too many open files in system” should document the steps in a new JIRA ticket.

    Nick has done lubm and the 10k indirects and never run into this. Josh ran the one-click on his machine and he may have had other applications which could have used up some file handles.

    FCREPO-2329 - Getting issue details... STATUS generally the error returned from Fedora is a 404 not a “Too many open files in system”. Remove that error from the ticket so as not to confuse the issue.

    Josh will test PR-7 and that will close FCREPO-2284 - Getting issue details... STATUS .

    FCREPO-2190 - Getting issue details... STATUS & FCREPO-2309 - Getting issue details... STATUS is done once Nick completes FCREPO-2332 - Getting issue details... STATUS .

    Josh will next take FCREPO-2303 - Getting issue details... STATUS .

    Probably need to walk through all the verification tickets and close tickets that might have been resolved by existing work.

    Summary T Assignee Reporter P Status Resolution
    Loading...
    Refresh

     

  3. Logging

    https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49

    There is different logging on the application side, FCREPO-2169 - Getting issue details... STATUS and FCREPO-2170 - Getting issue details... STATUS is about a different kind of log which is more of an audit log.

    FCREPO-2237 - Getting issue details... STATUS is a different issue but has some discussion around the log format in the notes.

     

  4. Esmé Cowles is creating a ticket for setting Digest header when importing checksum for binary

     

  5. Danny Bernstein is moving onto FCREPO-2296 - Getting issue details... STATUS .

  6. Andrew Woods suggests we all add more words in IRC Standup notes so people can understand where everyone is at.

 Debrief - 2016-12-16

Only a few tickets left inprogress and in review FCREPO-2365 - Getting issue details... STATUS

FCREPO-2328 - Getting issue details... STATUS - leaving for later.

 

Verification has some errors showing up, was kind of hard as import-export tool was constantly updating.

Perhaps not have both tools worked at same time would be good, but having lots of people around was helpful.

 

 — Good —

IRC standups +++

3 java developers.

For some on their first sprint attending meetings and learning the processes was helpful.

Nice having for testers to have developers available to ask questions.

Nice to not be a Java developer so they could use the tool more like an end user.

4 new people jump in successfully

2 people doing user testing

 

— Bad —

code reviews could take some time

people in and out during sprint/travel ++

LoC BagIt stuff

JIRA made it hard to see what was going on (maybe an embedded jira chart on the sprint page).

Felt like there wasn’t a lot to work on (for reviewing)

Using (clicking on) a JIRA label was handy once you figure it out. 

Nice to have Andrew around

Working on import/export and verification at the same time might be more pain than its worth.

 

—Questions —

With import/export and verification would it have useful to have matching tags between the two products to synchronize. — dev was too fast at this point and there is no release for either. 

 

— Next Steps —

Some stuff to get us to Stage 3

Lots of stakeholder feedback

Ready for a 0.1 release and have people try it out.

 

Leaving Bag profiles tickets open for now and have stakeholders verify that they are ready.

Standups

IRC Template

[Import/Export Standup]
Finished yesterday: 
  {ticket titles and associated JIRA links}
  {and/or brief textual description}
Working on today:
  {ticket titles and associated JIRA links}
  {and/or brief textual description}
Blockers:
  {brief textual description}
 Stand-up report - 2016-12-06

 

<ruebot> [Import/Export Standup]

19:26:17 < ruebot> [Import/Export Standup]
19:26:21 < ruebot> Finished yesterday:
19:26:25 < ruebot> (today)
19:26:29 < ruebot>   - Wearing sprint leader hat
19:26:32 < ruebot>   - Tested & resolved https://jira.duraspace.org/browse/FCREPO-2259
19:26:35 < ruebot>   - I shouldn't have assigned myself https://jira.duraspace.org/browse/FCREPO-2252
19:26:39 < ruebot>   - Testing/validation https://github.com/fcrepo4-labs/fcrepo-import-export/pull/47
19:26:45 < ruebot> Working on today (tomorrow):
19:26:50 < ruebot>   - https://jira.duraspace.org/browse/FCREPO-2237
19:26:53 < ruebot>   - Testing/validation https://github.com/fcrepo4-labs/fcrepo-import-export/pull/47
19:26:56 < ruebot>   - Testing/validation https://github.com/fcrepo4-labs/fcrepo-import-export/pull/48
19:26:59 < ruebot> Blockers:
19:27:02 < ruebot>   - I have an interview in the morning, and won't be back around until 11AM ET at the earliest

<awoods> [Import/Export Standup]

00:30:31 < awoods> Finished yesterday:
00:30:31 < awoods>   Updated JIRA permissions to allow "Reviewer" to close tickets
00:30:31 < awoods> Working on today:
00:30:31 < awoods>   Keeping up with sprint team activity... and helping when needed
00:30:31 < awoods> Blockers:
00:30:33 < awoods>   None

<justinsimpson> [Import/Export Standup]

08:41:48 < justinsimpson> Finished yesterday:
08:41:54 < justinsimpson> - attended first sprint
08:42:01 < justinsimpson> - reviewed documentation for FCREPO-2145 - Getting issue details... STATUS
08:42:06 < justinsimpson> Working on today:
08:42:13 < justinsimpson> - review Jira tickets related to Bag Profiles
08:42:19 < justinsimpson> - reinstalling vagrant vm with latest code
08:42:24 < justinsimpson> Blockers:
08:42:29 < justinsimpson> - I will be on irc only sporadically due to meetings today

<awead> [Import/Export Standup]

08:46:25 < awead> Finished yesterday:
08:46:27 < awead>   Approval of PR to add Hydra/Sufia dataset for testing
08:46:28 < awead> Working on today:
08:46:29 < awead>   Testing 2240 (Pair-trees)
08:46:30 < awead> Blockers:
08:46:31 < awead>   none

<escowles> [Import/Export Standup]

09:14:44 < escowles_> Yesterday: FCREPO-2240 Pairtrees should be Pairtrees
09:15:25 < escowles_> Today: Responding to testing, then FCREPO-2192 Adding more extensive integration tests
09:15:31 < escowles_> Blockers: None

 

<whikloj> [Import/Export Standup]

09:46:53 < whikloj> Finished yesterday:
09:46:56 < whikloj> nothing
09:47:02 < whikloj> Working on today:
09:47:11 < whikloj> FCREPO-2169 and FCREPO-2170
09:47:18 < whikloj> Blockers:
09:47:21 < whikloj> none

<pketienne> [Import/Export Standup]

09:51:28 < pketienne> Finished yesterday:
09:51:28 < pketienne>  - Investigated PSU infrastructure for backup.
09:51:28 < pketienne>  - Ran backup of Fedora 4.0 data off staging environment.
09:51:28 < pketienne> Working on Today:
09:51:28 >> OpenURL 11
09:51:28 < pketienne>  - Continue setting up full PSU export (https://jira.duraspace.org/browse/FCREPO-2326)
09:51:31 >> OpenURL 12
09:51:31 < pketienne>  - Attempt verification on PSU export (https://jira.duraspace.org/browse/FCREPO-2190)
09:51:33 < pketienne> Blockers:
09:51:35 < pketienne>  - None

<westgard> [Import/Export Standup]

10:03:29 < westgard> Finished yesterday:
10:03:31 < westgard>   Reviewing PR (https://github.com/fcrepo4-labs/fcrepo-import-export-verify/pull/7) for https://jira.duraspace.org/browse/FCREPO-2284
10:03:33 < westgard>   Created ticket for verification tool to handle ".external" resources (https://jira.duraspace.org/browse/FCREPO-2327)
10:03:35 < westgard>   Looked at https://jira.duraspace.org/browse/FCREPO-2322 and started thinking about what to do there.
10:03:37 < westgard> Working on today:
10:03:39 < westgard>   We involved in a search committee campus visit today, so time will be limited.  Will try to sort out above PR today.
10:03:41 < westgard> Blockers:
10:03:43 < westgard>   Question around two features of the verification tool (logging and verbose mode) and their relation to the above PR. We just need to decide what our goals for
                     those features are and then merge or update the PR accordingly.Y

< dbernstein> [Import/Export Standup]
12:35:50 < dbernstein> Finished yesterday: Nothing
12:35:51 < dbernstein> Working on today:
12:35:53 >> OpenURL 4
12:35:53 < dbernstein>   Working on FCREPO-2226 - Getting issue details... STATUS today
12:35:54 < dbernstein> Blockers:
12:35:54 < dbernstein>   None

 Stand-up report - 2016-12-07

< whikloj> [Import/Export Standup]
20:47:23 < whikloj> Finished yesterday: n/a
20:47:44 >> OpenURL 15
20:47:44 < whikloj> Working on today: Finish up https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49

< awoods> [Import/Export Standup]
00:14:11 < awoods> Finished yesterday:
00:14:11 < awoods>  - Reviewed/ReOpened: "Rip out the --binDir and --descDir"
00:14:11 < awoods>   ** https://jira.duraspace.org/browse/FCREPO-2226
00:14:11 < awoods>  - Reviewed/OK'd: "Can't import into sub-path"
00:14:13 < awoods>   ** https://jira.duraspace.org/browse/FCREPO-2328
00:14:15 < awoods> Working on today:
00:14:17 < awoods>  - Reviewing tickets as they come up
00:14:19 < awoods> Blockers:
00:14:21 < awoods>  - None


< dbernstein> [Import/Export Standup]
00:22:28 < dbernstein> Finished yesterday:
00:22:30 < dbernstein>   NA
00:22:31 < dbernstein> Working on today:
00:22:33 >> OpenURL 18
00:22:33 < dbernstein>   Finishing up https://jira.duraspace.org/browse/FCREPO-2226
00:22:34 >> OpenURL 19
00:22:34 < dbernstein>   Starting on https://jira.duraspace.org/browse/FCREPO-2296
00:22:35 < dbernstein> Blockers:
00:22:36 < dbernstein>   None

< awead> [Import/Export Standup]
08:48:36 < awead> Finished yesterday:
08:48:38 < awead>   https://jira.duraspace.org/browse/FCREPO-2240
08:48:39 < awead> Working on today:
08:48:40 < awead>   Nothing. Tag me as a reviewer on anything you need.
08:48:41 < awead> Blockers:
08:48:42 < awead>   I'll be offline for a little while today.

< ruebot> [Import/Export Standup]
08:50:27 < ruebot> Finished yesterday:
08:50:30 < ruebot>   - Test, merged https://github.com/fcrepo4-labs/fcrepo-import-export/pull/47
08:50:34 < ruebot>   - Tested, merged https://github.com/fcrepo4-labs/fcrepo-import-export/pull/50
08:50:37 < ruebot>   - Moved https://jira.duraspace.org/browse/FCREPO-2237 to phase 3
08:50:42 < ruebot>   - Testing, reviewing https://github.com/fcrepo4-labs/fcrepo-import-export/pull/48
08:50:52 < ruebot>   - Testing, reviewing https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49
08:50:57 < ruebot> Working on today:
08:51:01 < ruebot>   - Testing, reviewing https://github.com/fcrepo4-labs/fcrepo-import-export/pull/48
08:51:04 < ruebot>   - Testing, reviewing https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49
08:51:07 < ruebot>   - Sprint check-in call
08:51:10 < ruebot>   - Dive-in to https://github.com/fcrepo4-labs/fcrepo-import-export-verify
08:51:13 < ruebot> Blockers:
08:51:18 < ruebot>   - Nothing

< justinsimpson> [Import/Export Standup]
08:57:32 < justinsimpson> Finished yesterday:
08:57:38 < justinsimpson> -installed local vagrant box with FC 4.7.0
08:57:45 < justinsimpson> -reviewed docs and jira tickets on bag profiles
08:57:50 < justinsimpson> Working on today:
08:57:55 < justinsimpson>  -updating docs in confluence to reflect changes in FCREPO-2226 - Getting issue details... STATUS
08:58:00 < justinsimpson> -starting on bag profile for Archivematica
08:58:05 < justinsimpson> Blockers:
08:58:10 < justinsimpson> -I will miss the first half or 3/4 of the check-in call today, possibly the whole thing.  I will ping ruebot after for a link to notes

< escowles> [Import/Export Standup]
09:13:43 < escowles> - yesterday: finished FCREPO-2240 (skipping Pairtree resources) and worked on FCREPO-2328 (importing into subpath)
09:14:18 < escowles> - today: working on FCREPO-2192 (adding more rigorous integration tests)
09:14:34 < escowles> - blockers: none, but leaving early to take my daughter to the orthodontist

< pketienne> [Import/Export Standup]
09:27:35 < pketienne> Finished Yesterday:
09:27:35 < pketienne>  - Completed a few attempts at export of PSU production data.
09:27:35 < pketienne>  - Resolved HTTP 500 errors (halted export process) arising from some records' bad content.
09:27:35 < pketienne> Working on Today:
09:27:35 < pketienne>  - Complete final export of full PSU production data.
09:27:37 < pketienne>  - Begin FCREPO-2190 - Getting issue details... STATUS utilizing PSU prod export & PSU prod repo.
09:27:39 < pketienne> Blockers:
09:27:41 < pketienne>  - None

 Stand-up report - 2016-12-08

< escowles> [Import/Export Standup]
09:07:53 < escowles> yesterday: stopped work on https://jira.duraspace.org/browse/FCREPO-2328 (importing into subpath), started on https://jira.duraspace.org/browse/FCREPO-2192 (better integration tests)
09:08:25 < escowles> today: finish up integration tests, few hours of meetings, start on https://jira.duraspace.org/browse/FCREPO-2225 (recursive retrieval by custom predicates)
09:08:30 < escowles> blockers: none

< ruebot> [Import/Export Standup]
09:12:05 < ruebot> Finished yesterday:
09:12:08 < ruebot>   - Reviewing, testing, discussing https://github.com/fcrepo4-labs/fcrepo-import-export/pull/48
09:12:10 < ruebot>   - Reviewing, testing, discussing https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49
09:12:14 < ruebot> Working on today:
09:12:16 < ruebot>   - Hopefully merging:
09:12:19 < ruebot>     - Reviewing, testing, discussing https://github.com/fcrepo4-labs/fcrepo-import-export/pull/48
09:12:22 < ruebot>     - Reviewing, testing, discussing https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49
09:12:25 < ruebot>   - Writing some Java and Python for https://jira.duraspace.org/browse/FCREPO-2332 -- yaml for java, configparser for python
09:12:29 < ruebot> Blockers:
09:12:32 < ruebot>   - My skillset combined with the amount of time in a single day.

< awead> [Import/Export Standup]
09:20:38 < awead> Finished yesterday:
09:20:39 < awead>   nothing, I was out most of the day
09:20:41 < awead> Working on today:
09:20:42 < awead>   Nothing. :( Tag me as a reviewer on anything you need.
09:20:44 < awead> Blockers:
09:20:45 < awead>   none

< pketienne> [Import/Export Standup]
09:28:39 < pketienne> Finished Yesterday:
09:28:39 < pketienne>  - Finally resolved all http 500 issues which were preventing export of PSU data.
09:28:39 < pketienne>  - Completed a full export of PSU production data (pre FCREPO-2226 PR)
09:28:39 < pketienne>  - Completed a full export of PSU production data (post FCREPO-2226 PR)
09:28:41 < pketienne> Working on Today:
09:28:43 < pketienne>  - Run verification tool against full PSU production data set (pre 2226 PR)
09:28:45 < pketienne>  - Run verification tool against full PSU production data set (post 2226 PR)
09:28:47 < pketienne> Blockers:
09:28:49 < pketienne>  - None at the moment.

< justinsimpson> [Import/Export Standup]
09:51:59 < justinsimpson> Yesterday:
09:52:06 < justinsimpson> very little, bogged down by meetings
09:52:11 < justinsimpson> Today:
09:52:18 < justinsimpson> Updating docs for https://jira.duraspace.org/browse/FCREPO-2226
09:52:27 < justinsimpson> try to follow discussion on https://jira.duraspace.org/browse/FCREPO-2332
09:52:32 < justinsimpson> Blockers:
09:52:33 < justinsimpson> none

< westgard> [Import/Export Standup]
09:58:32 < westgard> Finished yesterday:
09:58:34 < westgard>   finished reviewing tool integration (FCREPO-2284) PR and merged
09:58:36 < westgard> Working on today:
09:58:38 < westgard>   started working on better error handling (FCREPO-2329)
09:58:40 < westgard> Blockers:
09:58:42 < westgard>   FCREPO-2327 (handle external resources) and FCREPO-2329 (handle missing resources) both depend somewhat on sorting out the config file change issue, but I have a local workaround in the meantime

< dbernstein> [Import/Export Standup]
10:17:39 < dbernstein> Finished yesterday:
10:17:41 < dbernstein>     https://jira.duraspace.org/browse/FCREPO-2226
10:17:42 < dbernstein>     (Rip out the --binDir and --descDir)
10:17:44 < dbernstein> Working on today:
10:17:45 < dbernstein>     Putting the finishing touches on
10:17:47 < dbernstein>     https://jira.duraspace.org/browse/FCREPO-2296
10:17:48 < dbernstein>     (implement binary redirects approach)
10:17:50 < dbernstein>     Mods + new unit tests are done and passing.
10:17:51 < dbernstein>     Will issue pull request later this morning.
10:17:52 < dbernstein> Blockers:
10:17:53 < dbernstein>    None.

< whikoj> [Import/Export Standup]
10:19:59 < whikloj> Finished yesterday: Most of https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49
10:20:13 < whikloj> Working on today:
10:21:13 < whikloj>   Take audit log out of logback and back into code, turn off by default and make log directory a config parameter
10:21:17 < whikloj> Blockers:
10:21:38 < whikloj>   None, but would be good to get some stakeholder feedback on the current work

 Stand-up report - 2016-12-09

< dbernstein> [Import/Export Standup]
00:39:34 < dbernstein> Finished yesterday:
00:39:36 < dbernstein>   FCREPO-2296 - Getting issue details... STATUS
00:39:37 < dbernstein>   Implement binary redirects export approach
00:39:39 < dbernstein>   Issued pull request
00:39:40 < dbernstein> Working on today:
00:39:42 < dbernstein>   Other than any feedback on the pull request
00:39:43 < dbernstein>   I’m not sure:  let’s talk about it.
00:39:44 < dbernstein> Blockers:
00:39:45 < dbernstein>   None

< ruebot> [Import/Export Standup]
09:21:57 < ruebot> Finished yesterday:
09:22:04 < ruebot>   - Worked on updating import-export utility to use a standardized config https://jira.duraspace.org/browse/FCREPO-2340 - whikloj took the baton
09:22:06 -!- coblej [~coblej@nc-71-51-253-144.dhcp.embarqhsd.net] has joined #fcrepo
09:22:08 < ruebot>   - Worked with westgard to resolve -- verification tool should handle up-to-date config file -- https://jira.duraspace.org/browse/FCREPO-2332
09:22:12 < ruebot> Working on today:
09:22:15 < ruebot>   - Outlining Import-Export Videos https://jira.duraspace.org/browse/FCREPO-2299
09:22:19 < ruebot>   - Test, validate, merge -- verification tool cannot handle exports performed with no binaries (-b flag) -- https://jira.duraspace.org/projects/FCREPO/issues/FCREPO-2342
09:22:22 < ruebot> Blockers:
09:22:25 < ruebot>   - A few conference calls today

< awead> [Import/Export Standup]
09:26:01 < awead> Finished yesterday:
09:26:03 < awead>   No tickets to review.
09:26:05 < awead> Working on today:
09:26:06 < awead>   Reviewing https://jira.duraspace.org/browse/FCREPO-2225
09:26:07 < awead> Blockers:
09:26:07 < awead>   none

< escowles> [import/export standup]
09:29:52 < escowles> * yesterday: added integration tests https://jira.duraspace.org/browse/FCREPO-2192
09:29:52 < escowles> * today: debug error messages https://jira.duraspace.org/browse/FCREPO-2330
09:29:54 < escowles>          debug losing namespaces https://jira.duraspace.org/browse/FCREPO-2252
09:29:56 < escowles> * blockers: none
09:30:28 < escowles> (also, almost done with sending digest with binary uploads https://jira.duraspace.org/browse/FCREPO-2334)

< informatician> [Import/Export Standup]

10:02:30 < informatician> Finished Yesterday:
10:02:30 < informatician>  - Nothing (*sadface)
10:02:30 < informatician> Working on Today:
10:02:30 < informatician>  - Re-attempt verification on completed export
10:02:30 < informatician>  - Set up Fedora 4.7 on production infrastructure
10:02:30 < informatician>  - Test fcr:restore (4.7) using fcr:backup (4.0)
10:02:31 < informatician>  - Test Import (4.7) using export (4.0)
10:02:31 < informatician> Blockers:
10:02:32 < informatician>  - Receiving HTTP 401 errors on use of verify.py.
10:02:32 < informatician>    Confirmed that correct credentials are being used.
10:02:33 < informatician>    Could this be due to running against fcrepo 4.0?

< westgard> [Import/Export Standup]
10:02:38 < westgard> Finished yesterday:
10:02:40 < westgard>   verification tool able to handle nobinaries option (FCREPO-2342)
10:02:42 < westgard> Working on today:
10:02:44 < westgard>   ticket to handle missing resources and continue after reporting error (FCREPO-2329)
10:02:46 < westgard>   ticket to ignore external binaries (FCREPO-2327)
10:02:48 < westgard> Blockers:
10:02:50 < westgard>   None
10:02:52 < westgard>   

< whikloj> [Import/Export Standup]
12:33:41 < whikloj> Finished yesterday:
12:34:10 < whikloj> FCREPO-2169 and FCREPO-2170 : https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49
12:34:21 < whikloj>    Above could use some eyes and testing.
12:34:55 < whikloj> Branch FCREPO-2340 - Added some stuff around using Yaml for the config file
12:35:04 < whikloj> Working on today:
12:35:29 < whikloj>   Continuing to work on FCREPO-2340
12:35:32 < whikloj> Blockers:
12:35:34 < whikloj>    none

 Stand-up report - 2016-12-12

awead: [Import/Export Standup]
08:51 awead: Finished Friday:
08:51 awead: Still working
08:51 awead: Working on today:
08:51 awead: Reviewing https://jira.duraspace.org/browse/FCREPO-2225
08:51 awead: Blockers:
08:51 awead: Traveling to Penn State today, will be offline most of the day

escowles: [Import/Export Standup]
09:44 escowles: friday: fixed bug where the importer was trying to parse binaries as RDF
09:44 escowles: * added support for custom membership predicates and sending checksums with binary uploads
09:44 escowles: * reviewed and merged PRs
09:44 escowles: today: starting on BagIt impl
09:44 escowles: * standing in for ruebot, so ping me if you need help/review/etc.
09:44 escowles: blockers: none

justinsimpson: [Import/Export Standup]
09:58 justinsimpson: Yesterday:
09:58 justinsimpson: nothing - was sick on Friday, just getting back now
09:58 justinsimpson: Working on today:
09:58 justinsimpson: Updating docs for https://jira.duraspace.org/browse/FCREPO-2226
09:58 justinsimpson: catching up on progress since Thursday
09:58 justinsimpson: Blockers:
09:58 justinsimpson: none

westgard: [Import/Export Standup]
10:09 westgard: Finished Friday:
10:09 westgard: created issue FCREPO-2347 (verification tool needs to infer extension) and did a PR to fix it
10:09 westgard: tested FCREPO-2332 (verification tool should handle up to date config file)
10:09 westgard: tested PR 58 (use YAML config) for the import-export tool
10:09 westgard: Working on today:
10:09 westgard: handle '.external' resources and better error handling
10:09 westgard: Blockers:
10:09 westgard: not a blocker but may be good to discuss: the main resource class in the verification tool probably needs to be refactored

Informatician: [Import/Export Standup]
10:13 informatician: Finished Friday:
10:13 informatician: - No items finished. Broke our staging server cluster (reverted to snapshot taken while troubleshooting verify.py).
10:13 informatician: - Recovered / restored staging servers back to proper health.
10:13 informatician: Working on Today:
10:13 informatician: - Continuing to troubleshoot verification tool against fcrepo 4.0.
10:13 informatician: - Testing verify.py against different versions of python (currently 2.6.6, will also try 2.7.x, 3.4)
10:13 informatician: - Will continue to setup debugging environment for testing verify.py against fcrepo 4.0.

dbernstein: [Import/Export Standup]
12:25 dbernstein: Finished yesterday:
12:25 dbernstein: https://jira.duraspace.org/browse/FCREPO-2296
12:25 dbernstein: Implement binary redirects export approach
12:25 dbernstein: Pull request tweaked and accepted
12:25 dbernstein: Working on today:
12:25 dbernstein: I’m not sure: let’s talk about it.
12:25 dbernstein: Blockers:
12:25 dbernstein: None

whikloj: [Import/Export Standup]

14:55 whikloj: Yesterday:
14:56 whikloj: Completed Yaml config changeover for import/export and verify tooling
14:56 whikloj: Today:
14:57 whikloj: Going to try FCREPO-2351 (ITs for BagIt)
14:57 whikloj: Blockers:
14:57 whikloj: None

 Stand-up report - 2016-12-13

escowles: [Import/Export standup]
09:47 escowles: * yesterday: initial BagIt export implementation and wrote tickets for rest of BagIt work
09:47 escowles: * today: working through the BagIt tickets and reviewing PRs
09:47 escowles: * blockers: some dependencies between the BagIt tickets, but shouldn't be a problem

westgard: [Import/Export Standup]
09:56 westgard: Finished yesterday:
09:56 westgard: Only a few discussions; my day job reared its ugly head.
09:57 westgard: Working on today:
09:57 westgard: Hopefully the external binaries and error handling ticket for the verification tool.
09:57 westgard: Blockers:
09:57 westgard: None.

awead: [Import/Export Standup]
10:02 awead: Finished Monday:
10:02 awead: Nothing, was in transit.
10:02 awead: Working on today:
10:02 awead: Hope to finish reviewing https://jira.duraspace.org/browse/FCREPO-2225
10:02 awead: Blockers:
10:02 awead: time.
10:31 awead: ruebot: amending my standup: Working on today:
10:31 awead:  Hope to finish reviewing https://jira.duraspace.org/browse/FCREPO-2354

whikloj: [Import/Export Standup]
10:03 whikloj: Yesterday: Reviewing some tickets and IT for Bagit
10:03 whikloj: Today: Thinking about Bagit Import (FCREPO-2350)
10:03 whikloj: Blockers: None

informatician: [Import/Export Standup]
10:11 informatician: Finished Yesterday:
10:11 informatician: - Successfully setup python 3.x on rhel 6.8 (prod data os) using "pyenv" and "pyenv-virtualenv".
10:11 informatician: - Successfully ran a new export of production data using latest version of export tool.
10:11 informatician: Working on Today:
10:11 informatician: - Setting up a python debugging environment.
10:11 informatician: - Troubleshooting http 401 errors (described below). Troubleshooting suggestions appreciated.
10:11 informatician: Blockers:
10:11 informatician: - Still hitting http 401 errors when attempting to run verify.py.
10:11 informatician: - When using valid credentials, receive (via stdout): urllib.error.HTTPError: HTTP Error 401: Unauthorized
10:11 informatician: - When using invalid credentials, receive (via log): Error communicating with repository. Response: 401 for node [url]

dbernstein: [Import/Export Standup]
13:48 dbernstein: Finished yesterday:
13:48 dbernstein:   Nothing.  I got pulled onto another project.
13:48 dbernstein: Working on today:
13:49 dbernstein: https://jira.duraspace.org/browse/FCREPO-2352
13:49 dbernstein:    Add support for user-supplied Bag metadata
13:49 dbernstein: Blockers:
13:49 dbernstein:  None
13:49 dbernstein: (sorry for the late report)

 Stand-up report - 2016-12-14

< justinsimpson> [Import/Export standup]
08:30:23 < justinsimpson> *yesterday: updated documentation in wiki for FCREPO-2226 - Getting issue details... STATUS
08:30:29 < justinsimpson> *today: very little, travelling today
08:30:34 < justinsimpson> *blockers: none

< westgard> [Import/Export Standup]
09:54:17 < westgard> Finished yesterday:
09:54:19 < westgard>   None. Again, the day job...
09:54:21 < westgard> Working on today:
09:54:23 < westgard>   Refactoring the resource class to make more maintainable and clearer code, and to accommodate external binaries.
09:54:25 < westgard>   We are closer to complete than the remaining tickets would suggest since many can be closed as soon as we have a v1.0 (they are the requirements).
09:54:27 < westgard> Blockers:
09:54:29 < westgard>   None.

< escowles> [Import/Export Standup]
10:01:18 < escowles> * yesterday: initial implementation of bag profiles
10:01:18 < escowles> * today: importing into existing containers https://jira.duraspace.org/browse/FCREPO-2202
10:01:20 < escowles>     mapping to different path/baseURL: https://jira.duraspace.org/browse/FCREPO-2328 & https://jira.duraspace.org/browse/FCREPO-2335
10:01:22 < escowles> * blockers: can't work on profile metadata support until we have user-supplied metadata (https://jira.duraspace.org/browse/FCREPO-2352)

< awead> [Import/Export Standup]
10:39:16 < awead> Finished yesterday:
10:39:18 < awead>   FCREPO-2354 - Getting issue details... STATUS
10:39:19 < awead> Working on today:
10:39:21 < awead>   Nothing. I’m available for reviewing.
10:39:22 < awead> Blockers:
10:39:23 < awead>   Meetings. I’ll be in and out and will miss the noon call.
10:39:31 < awead> oops. I meant Wednesday.


< whikloj> [Import/Export Standup]
11:11:11 < whikloj> Yesterday
11:11:28 < whikloj>    Some reviews/merges, some working on BagIt import, too much time with BagVerifier
11:11:32 < whikloj> Today:
11:11:52 < whikloj>    Finish BagIt importer and ITs, then something else
11:11:58 < whikloj> Blockers:
11:12:04 < whikloj>    A couple calls to attend

 Stand-up report - 2016-12-15

< ruebot> [Import/Export Standup]
08:26:20 < ruebot> Finished yesterday:
08:26:24 < ruebot>   - Tested all four datasets for -- Initial BagIt Import implementation -- https://jira.duraspace.org/browse/FCREPO-2350
08:26:26 < ruebot>   - Worked with Library of Congress on a couple issues with bagit-java and bagit-python
08:26:31 < ruebot>     - https://github.com/LibraryOfCongress/bagit-java/issues/72
08:26:35 < ruebot>     - https://github.com/LibraryOfCongress/bagit-python/issues/83
08:26:40 < ruebot>   - Worked on implementing -- Use newer version of LoC bagit library in import-export -- https://jira.duraspace.org/browse/FCREPO-2360
08:26:44 < ruebot>   - Resolved -- Create a config for the default BagIt Profile -- https://jira.duraspace.org/browse/FCREPO-2228
08:26:48 < ruebot> Working on today:
08:26:51 < ruebot>   - Sprint leader duties; Reviewing all open tickets
08:26:55 < ruebot> Blockers:
08:26:59 < ruebot>   - LoC bagit-java 5.0.0-RC10; requires a non-standard library, and conversations with the maintainer are awkward

< escowles> [Import/Export Standup]
09:35:16 < escowles> * yesterday: code review, documenting BagIt metadata requirements, tracking down bagit-java bugs
09:35:16 < escowles> * today: mostly meetings
09:35:18 < escowles> * blockers: ^^^

< justinsimpson> [Import/Export Standup]
09:59:14 < justinsimpson> yesterday: nothing, travel day
09:59:20 < justinsimpson> today: testing and looking at updating docs, e.g., https://github.com/fcrepo4-labs/fcrepo-import-export/pull/65
09:59:26 < justinsimpson> blockers: none

< whikloj> [Import/Export Standup]
10:09:52 < whikloj> Yesterday:
10:10:29 < whikloj>   Finished https://jira.duraspace.org/browse/FCREPO-2350, https://jira.duraspace.org/browse/FCREPO-2359
10:10:37 < whikloj>    Created and fixed, https://jira.duraspace.org/browse/FCREPO-2361
10:10:43 < whikloj> Today:
10:10:58 < whikloj>    Not sure what is a priority
10:11:04 < whikloj> Blockers:
10:11:06 < whikloj>   None

< awead> [Import/Export Standup]
10:18:20 < awead> Finished yesterday:
10:18:21 < awead>   Nothing
10:18:23 < awead> Working on today:
10:18:24 < awead>   Nothing :(
10:18:25 < awead> Blockers:
10:18:26 < awead>   Traveling, dodging snow.

< westgard> [Import/Export Standup]
11:46:21 < westgard> Finished yesterday:
11:46:23 < westgard>   first version of refactored main classes which also handles external binaries
11:46:25 < westgard> Working on today:
11:46:27 < westgard>   I had hoped to add better error handling to that and make the PR, but FCREPO-2362 has now come up...
11:46:29 < westgard>   I think probably the best way forward might be for me to do a PR right away with the refactored classes, but we don't merge it yet.  Then others can troubleshoot FCREPO-2362 against the PR?
11:46:31 < westgard> Blockers:
11:46:33 < westgard>   None.

  • No labels