Versions Compared

Old Version 40

changes.mady.by.user Danny Bernstein

Saved on

compared with

New Version Current

changes.mady.by.user Danny Bernstein

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Testing

...

Tickets

  • RC-1
    • blocker - 
      Jira
      serverDuraSpace JIRA
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2664

...

    • non-blocker - 
      Jira
      serverDuraSpace JIRA
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2666
    • non-blocker - 
      Jira
      serverDuraSpace JIRA
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2665

...

Hydra (instructions)

...

Project

...

Tested by

...

  • RC-

...

  • 2

      ...

        • blocker -

      ...

        • ...

          Jira

      ...

        • server

      ...

        • DuraSpace JIRA

      ...

        • columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
          serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
          keyFCREPO-2667


      External Projects

      Hydra (instructions)

      Project

      ...

      Esmé Cowles

      ...

      Esmé Cowles

      ...

      Islandora

       Project

      Tested by

      Success?

       RC

      RC-1

      		Success
      ?
      RC-2

      Notes

      CLAW
      ActiveFedora

      Jared Whiklo

      (tick)

      ...

      Esmé Cowles

      Stuart Kenny

      		(tick)


      (tick)


      Hyrax

      Esmé Cowles

      		(tick)



      SufiaJennifer Smith(tick)
      		Tested 7.3-stable branch
      Valkyrie

      Esmé Cowles

      Stuart Kenny

      		(tick)


      (tick)


      Avalon 6.0






      Islandora

       Project

      Tested by

      Success?

       RC

       RC-1

      		Success? RC-2

      Notes

      CLAW

      Jared Whiklo

      		(tick)(tick)


      API-X

      fcrepo-

       Project

      Tested by

      Success? RC-1

      		Success? RC-2

      Notes

      fcrepo-fcrepo-api-x-integrationapi-x-integration

      Aaron Birkland


      		(tick)


      fcrepo-api-x-demo (Docker)

      		(tick)

      Testing Plan

      Code Block
      git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout 4.7.5-RC

      Sanity Builds

      Scripts

      https://github.com/awoods/fcrepo-build-scripts

      ProjectCommandPlatformTested ByProjectCommandPlatformTested ByRC 1

      RC 2

      		Notes
      fcrepo4mvn clean install

      linux

      Andrew Woods

      		(tick)

      (tick) Jared Whiklo

      		 
      fcrepo4mvn clean install mac 

      Joshua Westgard

      Danny Bernstein (rc-2)

      		(tick)

      (tick)

      		Frequent warning: "Unable to update victims database! Your CVE records might be out of date."
      fcrepo4mvn clean installwindows

      Ben Pennell

      Aaron Birkland

      (error)

      (tick)


      (tick)


       I wasn't able to perform a sanity build in Windows 10 due to some integration tests in fcrepo-kernel-modeshape failing.  A few of them were failing because the last modified date for binaries was not updating all of the time (tests were flapping).

      Jira
      serverDuraSpace JIRA
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2665

      Danny Bernstein: NB - apparently this has been an ongoing issue. Danny Bernstein: NB - apparently this has been an ongoing issue. Apparently Windows 10 on hyper-v works, but is failing/flapping on direct windows install. Aaron Birkland and Yinlin Chen worked on resolving this a while back but did not crack it.

      fcrepo-module-auth-rbaclmvn clean installlinux

      Andrew Woods

      		(tick)

      (tick) Jared Whiklo

      		 
      fcrepo-module-auth-rbaclmvn clean install mac

      Peter Eichman

      Danny Bernstein(rc2)

      (tick)

      		(tick)

      Frequent warning: "Unable to update victims database! Your CVE records might be out of date."

      fcrepo-module-auth-rbaclmvn clean installwindowsAaron Birkland(tick)(tick) fcrepo-module-auth-xacmlmvn clean install linuxAndrew Woods(tick) 
      fcrepo-module-auth-xacmlmvn clean install mac

      Peter Eichman

      Danny Bernstein (rc2)

      		???(tick)No 4.7.5-RC branch or tag
      fcrepo-module-auth-xacmlmvn clean installwindows


      		 
      fcrepo-module-auth-webacmvn clean install linux

      Andrew Woods

      		(tick)

      (tick) Jared Whiklo

      		 
      fcrepo-module-auth-webacmvn clean install mac

      Peter Eichman

      Danny Bernstein (rc2)

      		(tick)(tick)

      Frequent warning: "Unable to update victims database! Your CVE records might be out of date."

      fcrepo-module-auth-webacmvn clean installwindowsAaron Birkland(tick)(tick) 
      fcrepo-mintmvn clean install linux

      Andrew Woods

      		(tick)

      (tick) Jared Whiklo

      		 
      fcrepo-mintmvn clean install mac

      Peter Eichman

      Danny Bernstein (rc-2)

      		(tick)(tick)

      Frequent warning: "Unable to update victims database! Your CVE records might be out of date."

      fcrepo-mintmvn clean installwindowsAaron Birkland(tick)(tick) 
      fcrepo-auditmvn clean install linux

      Andrew Woods

      		(tick)

      (tick) Jared Whiklo

      		  
      fcrepo-auditmvn clean install mac

      Peter Eichman

      Danny Bernstein (rc-2)

      		(tick)(tick)Frequent warning: "Unable to update victims database! Your CVE records might be out of date."
      fcrepo-auditmvn clean installwindowsAaron Birkland(tick)(tick) 
      fcrepo-webapp-plusmvn clean install linux

      Andrew Woods

      		(tick)

      (tick) Jared Whiklo

      		 
      fcrepo-webapp-plusmvn clean install 

      mac

      Danny Bernstein (rc-2)

      Peter Eichman

      		(tick)(tick)Frequent warning: "Unable to update victims database! Your CVE records might be out of date."
      fcrepo-webapp-plusmvn clean install windowsAaron Birkland(tick)(tick) 
      fcrepo-webapp-plusmvn clean install -Pwebac linux

      Andrew Woods

      		(tick)

      (tick) Jared Whiklo

       

      fcrepo-webapp-plusmvn clean install -Pwebac

      mac

      Danny Bernstein (rc-2)

      Peter Eichman

      		(tick)(tick)Frequent warning: "Unable to update victims database! Your CVE records might be out of date."
      fcrepo-webapp-plusmvn clean install -PwebacwindowsAaron Birkland(tick)(tick) 

      ...

      CommandPlatformTested ByRC-1RC-2Notes
      java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarLinux

      Andrew Woods

      Jared Whiklo (RC 2)

      		(tick)(tick) 
      java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jarMac

      Joshua Westgard

      Danny Bernstein (rc2)

      		(tick)(tick) 

      java -jar fcrepo-webapp-<version>-SNAPSHOT-jetty-console.jar

      		Windows

      Aaron Birkland

      		(tick)(tick) 

      ...

      DatabasePlatformTested bySuccess RC1?Success RC2?Notes
      MySQL osx

       Danny Bernstein

      Joshua Westgard

      (tick)

      (tick)

      		(tick)

      Danny Bernstein: Restoring v1 after creating v2 does not seem to work:

      Steps to reproduce: 1. Create a binary with fileA.jpg

      2. Create version v1.

      3. Update binary with fileB.jpg

      4. Create version v2.

      5. Click on versions link and click on v1 link.

      6. Click "Revert to this Version"

      7. Return to binary resource metadata page. Notice the file associated with the version fileB.jpg rather than the expected fileA.jpg. It does not appear that the version was reverted.

      Joshua Westgard: Hey Danny Bernstein, when I tested the versioning I was just making changes to metadata not binaries and didn't notice any problems; after seeing your note, however, I tried with a binary and did notice that the browser cached the previous version, so after restoring it was still displaying the previous data, but upon refreshing the resource page the restored version was visible as expected. Any chance this is the same problem you were seeing?

      Joshua Westgard: could be, though I thought I did a hard refresh. I'll try it again to conf hirm.

      Joshua Westgard: I must not have done a hard refresh. So yes after a hard refresh it worked. I wonder if it should be a logged as a bug nevertheless. Ideally any refresh would not be required at all. A Command-R refresh doesn't refresh the page. Only Command-Shift-R. It seems like it could be a source of confusion. Perhaps a JIRA is warranted. Here it is:

      Jira
      serverDuraSpace JIRA
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5
      keyFCREPO-2666


      PostgreSQLosxJoshua Westgardconfig successful; testing in progress

      PostgreSQL linuxKevin Ford

      Tests were performed against fcrepo-webapp-4.7.5-RC -1 not fcrepo-webapp-plus-4.7.5-RC-1.  

      MySQL5.6 linuxKevin Ford

      Tests were performed against fcrepo-webapp-4.7.5-RC -1 not fcrepo-webapp-plus-4.7.5-RC-1.  

      PostgreSQL linuxKevin Ford

      Tests were performed against fcrepo-webapp-plus-4.7.5-RC-1.  

      MySQL5.6 linuxKevin Ford

      Tests were performed against fcrepo-webapp-plus-4.7.5-RC-1.  

      fcr:backup/fcr:restore Functionality

      ...

      Tested by

      Platform

      Container

      (Tomcat/Jetty)

      Database

      Backend

      From Fedora
      Version

      To Fedora 
      Version

      Number of

      RDF Resources

      Number of

      Binaries

      Size of Backup (du -h .)

      Success RC1?

      		Success RC2?

      Notes                  


      		LinuxJettyFile-simple4.7.54.7.5
      		100



      Kevin Ford

      		LinuxTomcatPostgres4.7.14.7.5-RC-1640064006.7 G(tick)

      (tick)

      Performed a GET test on all resources in 4.7.5 RC1 before /fcr:restore, thereby mimicking an 'in place upgrade.'  All succeeded.

      RC2 test used backup of 471 from RC1 test.

      Kevin Kevin Ford

      		LinuxTomcatPostgres4.7.34.7.5-RC-1640064006.7 G(tick)

      (tick)

      Performed a GET test on all resources in 4.7.5 RC1 before /fcr:restore, thereby mimicking an 'in place upgrade.'  All succeeded.

      RC2 test used backup of 473 from RC1 test.

      Kevin Ford

      		LinuxTomcatPostgres4.7.44.7.5-RC-1640064006.7 G(tick)

      (tick)

      Performed a GET test on all resources in 4.7.5 RC1 before /fcr:restore, thereby mimicking an 'in place upgrade.'  All succeeded.

      RC2 test used backup of 474 from RC1 test.

      Michael Durbin

      		LinuxTomcatMysql4.7.44.7.5-RC-1794561196996G(tick)
      		Performed an fcr:export from 4.7.4.  Performed an fcr:import to 4.7.5-RC-1.  Performed a reindex using camel (to walk all RDF resources).  I did not test every binary.

      Kevin Ford

      		LinuxTomcatMysql 5.64.7.54.7.5-RC-1640064006.7 G(tick)

      Kevin Ford

      		LinuxTomcatPostgres

      (tick)

      Performed a GET test on all resources in 4.7.5 RC1 before /fcr:restore, as verification. All succeeded.

      For RC2 test, the back up that was restored in this test was actually created from a postgres backend repo.

      Kevin Ford

      		LinuxTomcatPostgres4.7.54.7.5-RC-1640064006.7 G(tick)

      (tick)

      Performed a GET test on all resources in 4.7.5 RC2 before /fcr:restore, as verification. All succeeded.

      For RC1 test, the back up that was restored in this test was actually

      Back up actually

      created from a mysql backend repo.

      NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages. 

      ...

      true
      Test stepsTested BySuccess RC2?Notes

      FEDORA_AUTH=true
      FEDORA_AUDIT=false

      		 

      FEDORA_AUTH=false
      FEDORA_AUDIT=false

      Bethany Seeger

      		(tick)(tick) auth working

      (tick) audit disabled

      (tick) triplestore is staying in sync

      (tick) solr

      (tick) triplestore reindexing 

      FEDORA_AUTH=

      false
      FEDORA_AUDIT=false

      Danny Bernstein

      		(tick)

       (tick) auth (disabled as expected)

      (tick) audit disabled

      (tick) triplestore is staying in sync

      (tick) solr

      (tick) triplestore reindexingtrue

      FEDORA_AUTH=falsetrue
      FEDORA_AUDIT=true

      Manual Tests

      Danny Bernstein

      		(tick)

      (tick) Triple Store

      (tick) Auth

      (tick) Reindexing

      (tick) Solr (after a "vagrant box update" and "vagrant destroy" it seems to work now).

      (warning)However: if I add an RDF triple to a node (in my case <> dc:title "blah") , I'm am not seeing the change reflected in solr. The triple is however present in fuseki.

      Is this expected behavior? ie are only some triples propagated to solr?

      The above turns out not to be an issue. Updates to solr are collected and then execute in batch operations. I just needed to wait a few seconds.

      (tick) Audit events: with this caveat

      (warning) I am seeing this stacktrace in the karaf logs upon adding a resource. Not sure if it is a problem. Audit events are being logged properly as far as I can tell in /audit and fuseki is also receiving the audit triples.

      sudo tail -f /opt/karaf/data/log/karaf.log:

      Stacktrace
      ---------------------------------------------------------------------------------------------------------------------------------------
      org.fcrepo.client.FcrepoOperationFailedException: HTTP operation failed invoking info:fedora/audit with statusCode: -1 and message: URI does not specify a valid host name: info:fedora/audit
      at org.fcrepo.client.FcrepoClient.executeRequest(FcrepoClient.java:218)[152:org.fcrepo.client.fcrepo-java-client:0.2.1]
      at org.fcrepo.client.FcrepoClient.executeRequest(FcrepoClient.java:204)[152:org.fcrepo.client.fcrepo-java-client:0.2.1]
      at org.fcrepo.client.RequestBuilder.perform(RequestBuilder.java:77)[152:org.fcrepo.client.fcrepo-java-client:0.2.1]
      at org.fcrepo.camel.FcrepoProducer.getMetadataUri(FcrepoProducer.java:251)[201:org.fcrepo.camel.fcrepo-camel:4.5.0]
      at org.fcrepo.camel.FcrepoProducer.getUri(FcrepoProducer.java:225)[201:org.fcrepo.camel.fcrepo-camel:4.5.0]
      at org.fcrepo.camel.FcrepoProducer.doRequest(FcrepoProducer.java:194)[201:org.fcrepo.camel.fcrepo-camel:4.5.0]
      at org.fcrepo.camel.FcrepoProducer.process(FcrepoProducer.java:156)[201:org.fcrepo.camel.fcrepo-camel:4.5.0]
      at org.apache.camel.util.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:61)[58:org.apache.camel.camel-core:2.18.0]
      at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:145)[58:org.apache.camel.camel-core:2.18.0]
      at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:77)[

      (info) I confirmed that this behavior exists in in the 4.7.4

      FEDORA_AUTH=false
      FEDORA_AUDIT=true

      Danny Bernstein

      		(tick)(tick)

      Manual Tests

      Same as above, plus:

      (for reference: https://docs.google.com/presentation/d/1aU-qRVmU0lB18ywepk2AGYEmRe-HfIwhUaofHgathGQ/edit#slide=id.g11caa1fd99_0_0)Same as above, plus:

      1. Verify audit events are in triplestore
      2. Verify resources are in triplestore
      3. Verify resources are in Solr
      4. Verify authorization works for the two auth-enabled configurationsworks for the two auth-enabled configurations

      5. Verify reindexing to triplestore works

        Code Block
        vagrant ssh
sudo service tomcat7 stop
sudo rm -rf /etc/fuseki/databases/test_data/*
sudo service tomcat7 start
curl -XPOST localhost:9080/reindexing/ -H"Content-Type: application/json" -d '["activemq:queue:triplestore.reindex"]'
        Verify reindexing to triplestore works

      Backwards Compatibility Tests
      ...
      Tested bySuccess RC1Success RC2Notes
      Kevin Ford
      		(tick)(tick)Did not run camel_toolbox_tests or authz_tests.
      Danny Bernstein

      		(tick)
      Resources
      [1] Testing scripts
      ...