Page History

< dbernstein> [Import/Export Standup]
00:39:34 < dbernstein> Finished yesterday:
00:39:36 < dbernstein>  

< ruebot> [Import/Export Standup]
09:21:57 < ruebot> Finished yesterday:
09:22:04 < ruebot>   - Worked on updating import-export utility to use a standardized config https://jira.duraspace.org/browse/FCREPO-2340 - whikloj took the baton
09:22:06 -!- coblej [~coblej@nc-71-51-253-144.dhcp.embarqhsd.net] has joined #fcrepo
09:22:08 < ruebot>   - Worked with westgard to resolve -- verification tool should handle up-to-date config file -- https://jira.duraspace.org/browse/FCREPO-2332
09:22:12 < ruebot> Working on today:
09:22:15 < ruebot>   - Outlining Import-Export Videos https://jira.duraspace.org/browse/FCREPO-2299
09:22:19 < ruebot>   - Test, validate, merge -- verification tool cannot handle exports performed with no binaries (-b flag) -- https://jira.duraspace.org/projects/FCREPO/issues/FCREPO-2342
09:22:22 < ruebot> Blockers:
09:22:25 < ruebot>   - A few conference calls today

< awead> [Import/Export Standup]
09:26:01 < awead> Finished yesterday:
09:26:03 < awead>   No tickets to review.
09:26:05 < awead> Working on today:
09:26:06 < awead>   Reviewing https://jira.duraspace.org/browse/FCREPO-2225
09:26:07 < awead> Blockers:
09:26:07 < awead>   none

< escowles> [import/export standup]
09:29:52 < escowles> * yesterday: added integration tests https://jira.duraspace.org/browse/FCREPO-2192
09:29:52 < escowles> * today: debug error messages https://jira.duraspace.org/browse/FCREPO-2330
09:29:54 < escowles>          debug losing namespaces https://jira.duraspace.org/browse/FCREPO-2252
09:29:56 < escowles> * blockers: none
09:30:28 < escowles> (also, almost done with sending digest with binary uploads https://jira.duraspace.org/browse/FCREPO-2334)

< informatician> [Import/Export Standup]
10:02:30 < informatician> Finished Yesterday:
10:02:30 < informatician>  - Nothing (*sadface)
10:02:30 < informatician> Working on Today:
10:02:30 < informatician>  - Re-attempt verification on completed export
10:02:30 < informatician>  - Set up Fedora 4.7 on production infrastructure
10:02:30 < informatician>  - Test fcr:restore (4.7) using fcr:backup (4.0)
10:02:31 < informatician>  - Test Import (4.7) using export (4.0)
10:02:31 < informatician> Blockers:
10:02:32 < informatician>  - Receiving HTTP 401 errors on use of verify.py.
10:02:32 < informatician>    Confirmed that correct credentials are being used.
10:02:33 < informatician>    Could this be due to running against fcrepo 4.0?

< westgard> [Import/Export Standup]
10:02:38 < westgard> Finished yesterday:
10:02:40 < westgard>   verification tool able to handle nobinaries option (FCREPO-2342)
10:02:42 < westgard> Working on today:
10:02:44 < westgard>   ticket to handle missing resources and continue after reporting error (FCREPO-2329)
10:02:46 < westgard>   ticket to ignore external binaries (FCREPO-2327)
10:02:48 < westgard> Blockers:
10:02:50 < westgard>   None
10:02:52 < westgard>   

< whikloj> [Import/Export Standup]
12:33:41 < whikloj> Finished yesterday:
12:34:10 < whikloj> FCREPO-2169 and FCREPO-2170 : https://github.com/fcrepo4-labs/fcrepo-import-export/pull/49
12:34:21 < whikloj>    Above could use some eyes and testing.
12:34:55 < whikloj> Branch FCREPO-2340 - Added some stuff around using Yaml for the config file
12:35:04 < whikloj> Working on today:
12:35:29 < whikloj>   Continuing to work on FCREPO-2340
12:35:32 < whikloj> Blockers:
12:35:34 < whikloj>    none

awead: [Import/Export Standup]
08:51 awead: Finished Friday:
08:51 awead: Still working
08:51 awead: Working on today:
08:51 awead: Reviewing https://jira.duraspace.org/browse/FCREPO-2225
08:51 awead: Blockers:
08:51 awead: Traveling to Penn State today, will be offline most of the day

escowles: [Import/Export Standup]
09:44 escowles: friday: fixed bug where the importer was trying to parse binaries as RDF
09:44 escowles: * added support for custom membership predicates and sending checksums with binary uploads
09:44 escowles: * reviewed and merged PRs
09:44 escowles: today: starting on BagIt impl
09:44 escowles: * standing in for ruebot, so ping me if you need help/review/etc.
09:44 escowles: blockers: none

justinsimpson: [Import/Export Standup]
09:58 justinsimpson: Yesterday:
09:58 justinsimpson: nothing - was sick on Friday, just getting back now
09:58 justinsimpson: Working on today:
09:58 justinsimpson: Updating docs for https://jira.duraspace.org/browse/FCREPO-2226
09:58 justinsimpson: catching up on progress since Thursday
09:58 justinsimpson: Blockers:
09:58 justinsimpson: none

westgard: [Import/Export Standup]
10:09 westgard: Finished Friday:
10:09 westgard: created issue FCREPO-2347 (verification tool needs to infer extension) and did a PR to fix it
10:09 westgard: tested FCREPO-2332 (verification tool should handle up to date config file)
10:09 westgard: tested PR 58 (use YAML config) for the import-export tool
10:09 westgard: Working on today:
10:09 westgard: handle '.external' resources and better error handling
10:09 westgard: Blockers:
10:09 westgard: not a blocker but may be good to discuss: the main resource class in the verification tool probably needs to be refactored

Informatician: [Import/Export Standup]
10:13 informatician: Finished Friday:
10:13 informatician: - No items finished. Broke our staging server cluster (reverted to snapshot taken while troubleshooting verify.py).
10:13 informatician: - Recovered / restored staging servers back to proper health.
10:13 informatician: Working on Today:
10:13 informatician: - Continuing to troubleshoot verification tool against fcrepo 4.0.
10:13 informatician: - Testing verify.py against different versions of python (currently 2.6.6, will also try 2.7.x, 3.4)
10:13 informatician: - Will continue to setup debugging environment for testing verify.py against fcrepo 4.0.

dbernstein: [Import/Export Standup]
12:25 dbernstein: Finished yesterday:
12:25 dbernstein: https://jira.duraspace.org/browse/FCREPO-2296
12:25 dbernstein: Implement binary redirects export approach
12:25 dbernstein: Pull request tweaked and accepted
12:25 dbernstein: Working on today:
12:25 dbernstein: I’m not sure: let’s talk about it.
12:25 dbernstein: Blockers:
12:25 dbernstein: None

whikloj: [Import/Export Standup]

14:55 whikloj: Yesterday:
14:56 whikloj: Completed Yaml config changeover for import/export and verify tooling
14:56 whikloj: Today:
14:57 whikloj: Going to try FCREPO-2351 (ITs for BagIt)
14:57 whikloj: Blockers:
14:57 whikloj: None

escowles: [Import/Export standup]
09:47 escowles: * yesterday: initial BagIt export implementation and wrote tickets for rest of BagIt work
09:47 escowles: * today: working through the BagIt tickets and reviewing PRs
09:47 escowles: * blockers: some dependencies between the BagIt tickets, but shouldn't be a problem

westgard: [Import/Export Standup]
09:56 westgard: Finished yesterday:
09:56 westgard: Only a few discussions; my day job reared its ugly head.
09:57 westgard: Working on today:
09:57 westgard: Hopefully the external binaries and error handling ticket for the verification tool.
09:57 westgard: Blockers:
09:57 westgard: None.

awead: [Import/Export Standup]
10:02 awead: Finished Monday:
10:02 awead: Nothing, was in transit.
10:02 awead: Working on today:
10:02 awead: Hope to finish reviewing https://jira.duraspace.org/browse/FCREPO-2225
10:02 awead: Blockers:
10:02 awead: time.
10:31 awead: ruebot: amending my standup: Working on today:
10:31 awead:  Hope to finish reviewing https://jira.duraspace.org/browse/FCREPO-2354

whikloj: [Import/Export Standup]
10:03 whikloj: Yesterday: Reviewing some tickets and IT for Bagit
10:03 whikloj: Today: Thinking about Bagit Import (FCREPO-2350)
10:03 whikloj: Blockers: None

informatician: [Import/Export Standup]
10:11 informatician: Finished Yesterday:
10:11 informatician: - Successfully setup python 3.x on rhel 6.8 (prod data os) using "pyenv" and "pyenv-virtualenv".
10:11 informatician: - Successfully ran a new export of production data using latest version of export tool.
10:11 informatician: Working on Today:
10:11 informatician: - Setting up a python debugging environment.
10:11 informatician: - Troubleshooting http 401 errors (described below). Troubleshooting suggestions appreciated.
10:11 informatician: Blockers:
10:11 informatician: - Still hitting http 401 errors when attempting to run verify.py.
10:11 informatician: - When using valid credentials, receive (via stdout): urllib.error.HTTPError: HTTP Error 401: Unauthorized
10:11 informatician: - When using invalid credentials, receive (via log): Error communicating with repository. Response: 401 for node [url]

dbernstein: [Import/Export Standup]
13:48 dbernstein: Finished yesterday:
13:48 dbernstein:   Nothing.  I got pulled onto another project.
13:48 dbernstein: Working on today:
13:49 dbernstein: https://jira.duraspace.org/browse/FCREPO-2352
13:49 dbernstein:    Add support for user-supplied Bag metadata
13:49 dbernstein: Blockers:
13:49 dbernstein:  None
13:49 dbernstein: (sorry for the late report)

< justinsimpson> [Import/Export standup]
08:30:23 < justinsimpson> *yesterday: updated documentation in wiki for

< westgard> [Import/Export Standup]
09:54:17 < westgard> Finished yesterday:
09:54:19 < westgard>   None. Again, the day job...
09:54:21 < westgard> Working on today:
09:54:23 < westgard>   Refactoring the resource class to make more maintainable and clearer code, and to accommodate external binaries.
09:54:25 < westgard>   We are closer to complete than the remaining tickets would suggest since many can be closed as soon as we have a v1.0 (they are the requirements).
09:54:27 < westgard> Blockers:
09:54:29 < westgard>   None.

< escowles> [Import/Export Standup]
10:01:18 < escowles> * yesterday: initial implementation of bag profiles
10:01:18 < escowles> * today: importing into existing containers https://jira.duraspace.org/browse/FCREPO-2202
10:01:20 < escowles>     mapping to different path/baseURL: https://jira.duraspace.org/browse/FCREPO-2328 & https://jira.duraspace.org/browse/FCREPO-2335
10:01:22 < escowles> * blockers: can't work on profile metadata support until we have user-supplied metadata (https://jira.duraspace.org/browse/FCREPO-2352)

< awead> [Import/Export Standup]
10:39:16 < awead> Finished yesterday:
10:39:18 < awead>  

< whikloj> [Import/Export Standup]
11:11:11 < whikloj> Yesterday
11:11:28 < whikloj>    Some reviews/merges, some working on BagIt import, too much time with BagVerifier
11:11:32 < whikloj> Today:
11:11:52 < whikloj>    Finish BagIt importer and ITs, then something else
11:11:58 < whikloj> Blockers:
11:12:04 < whikloj>    A couple calls to attend

< ruebot> [Import/Export Standup]
08:26:20 < ruebot> Finished yesterday:
08:26:24 < ruebot>   - Tested all four datasets for -- Initial BagIt Import implementation -- https://jira.duraspace.org/browse/FCREPO-2350
08:26:26 < ruebot>   - Worked with Library of Congress on a couple issues with bagit-java and bagit-python
08:26:31 < ruebot>     - https://github.com/LibraryOfCongress/bagit-java/issues/72
08:26:35 < ruebot>     - https://github.com/LibraryOfCongress/bagit-python/issues/83
08:26:40 < ruebot>   - Worked on implementing -- Use newer version of LoC bagit library in import-export -- https://jira.duraspace.org/browse/FCREPO-2360
08:26:44 < ruebot>   - Resolved -- Create a config for the default BagIt Profile -- https://jira.duraspace.org/browse/FCREPO-2228
08:26:48 < ruebot> Working on today:
08:26:51 < ruebot>   - Sprint leader duties; Reviewing all open tickets
08:26:55 < ruebot> Blockers:
08:26:59 < ruebot>   - LoC bagit-java 5.0.0-RC10; requires a non-standard library, and conversations with the maintainer are awkward

< escowles> [Import/Export Standup]
09:35:16 < escowles> * yesterday: code review, documenting BagIt metadata requirements, tracking down bagit-java bugs
09:35:16 < escowles> * today: mostly meetings
09:35:18 < escowles> * blockers: ^^^

< justinsimpson> [Import/Export Standup]
09:59:14 < justinsimpson> yesterday: nothing, travel day
09:59:20 < justinsimpson> today: testing and looking at updating docs, e.g., https://github.com/fcrepo4-labs/fcrepo-import-export/pull/65
09:59:26 < justinsimpson> blockers: none

< whikloj> [Import/Export Standup]
10:09:52 < whikloj> Yesterday:
10:10:29 < whikloj>   Finished https://jira.duraspace.org/browse/FCREPO-2350, https://jira.duraspace.org/browse/FCREPO-2359
10:10:37 < whikloj>    Created and fixed, https://jira.duraspace.org/browse/FCREPO-2361
10:10:43 < whikloj> Today:
10:10:58 < whikloj>    Not sure what is a priority
10:11:04 < whikloj> Blockers:
10:11:06 < whikloj>   None

< awead> [Import/Export Standup]
10:18:20 < awead> Finished yesterday:
10:18:21 < awead>   Nothing
10:18:23 < awead> Working on today:
10:18:24 < awead>   Nothing :(
10:18:25 < awead> Blockers:
10:18:26 < awead>   Traveling, dodging snow.

< westgard> [Import/Export Standup]
11:46:21 < westgard> Finished yesterday:
11:46:23 < westgard>   first version of refactored main classes which also handles external binaries
11:46:25 < westgard> Working on today:
11:46:27 < westgard>   I had hoped to add better error handling to that and make the PR, but FCREPO-2362 has now come up...
11:46:29 < westgard>   I think probably the best way forward might be for me to do a PR right away with the refactored classes, but we don't merge it yet.  Then others can troubleshoot FCREPO-2362 against the PR?
11:46:31 < westgard> Blockers:
11:46:33 < westgard>   None.