Issues found during testing

External Projects

Hydra

ProjectTested bySuccess? RC-1Notes
ActiveFedora

Esmé Cowles

(tick)
CurationConcerns

Esmé Cowles  

*

 1 test failure, but same failure seen with 4.7.1 and 4.6.1
HyraxEsmé Cowles(tick)
Plum

Esmé Cowles  

(tick) 
Sufia

Esmé Cowles  

(tick) 

 

Islandora

 ProjectTested bySuccess? RC-1Notes
CLAW

Nick Ruest

(tick) claw_vagrant

Testing Plan

git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout 4.7.2-RC

Sanity Builds

ProjectCommandPlatformTested bySuccess? RC-1Notes
fcrepo4mvn clean install

linux

Andrew Woods

Nick Ruest

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo4mvn clean install mac 

Mark A. Matienzo

Adam Wead

(tick)

(tick)

macOS 10.11.6

macOS 10.12.3

fcrepo4mvn clean installwindowsAaron Birkland(tick)Windows 10
fcrepo-module-auth-rbaclmvn clean installlinux

Andrew Woods    

Nick Ruest

(tick)

(tick)

 

Ubuntu 16.10

Ubuntu 16.04

fcrepo-module-auth-rbaclmvn clean install mac

Mark A. Matienzo

(tick)macOS 10.11.6
fcrepo-module-auth-rbaclmvn clean installwindowsAaron Birkland(tick)Windows 10
fcrepo-module-auth-xacmlmvn clean install linux

Andrew Woods  

Nick Ruest 

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04 

fcrepo-module-auth-xacmlmvn clean install mac
Mark A. Matienzo


(tick)macOS 10.11.6
fcrepo-module-auth-xacmlmvn clean installwindowsAaron Birkland(tick)Windows 10
fcrepo-module-auth-webacmvn clean install linux

Andrew Woods  

Nick Ruest

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo-module-auth-webacmvn clean install mac

Mark A. Matienzo

(tick)macOS 10.11.6
fcrepo-module-auth-webacmvn clean installwindows

Aaron Birkland

(tick)Windows 10
fcrepo-mintmvn clean install linux

Andrew Woods  

Nick Ruest

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

 
fcrepo-mintmvn clean install mac

Mark A. Matienzo

(tick)macOS 10.11.6
fcrepo-mintmvn clean installwindows

Aaron Birkland

(tick)Windows 10
fcrepo-auditmvn clean install linux

Andrew Woods  

Nick Ruest

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

 
fcrepo-auditmvn clean install mac

Mark A. Matienzo

(tick)macOS 10.11.6
fcrepo-auditmvn clean installwindows

Aaron Birkland

(tick)Windows 10
fcrepo-webapp-plusmvn clean install linux

Andrew Woods

Nick Ruest

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo-webapp-plusmvn clean install mac

Mark A. Matienzo

(tick)macOS 10.11.6
fcrepo-webapp-plusmvn clean install windowsAaron Birkland(tick)Windows `0
fcrepo-webapp-plusmvn clean install -Prbacl linux

Andrew Woods

Nick Ruest

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo-webapp-plusmvn clean install -Prbaclmac

Mark A. Matienzo

(tick)macOS 10.11.6
fcrepo-webapp-plusmvn clean install -Prbaclwindows

Aaron Birkland

(tick)Windows 10
fcrepo-webapp-plusmvn clean install -Pxacmllinux

Andrew Woods

Nick Ruest

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo-webapp-plusmvn clean install -Pxacmlmac

Mark A. Matienzo

(tick)macOS 10.11.6
fcrepo-webapp-plusmvn clean install -PxacmlwindowsAaron Birkland(tick)Windows 10

One-Click Run

cd fcrepo-webapp; mvn clean install -Pone-click
CommandPlatform Tested bySuccess?  RC-1Notes
java -jar fcrepo-webapp-<version>-jetty-console.jar Linux

Andrew Woods

Nick Ruest

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

java -jar fcrepo-webapp-<version>-jetty-console.jarMac

Mark A. Matienzo

(tick)macOS 10.11.6

java -jar fcrepo-webapp-<version>-jetty-console.jar

Windows

Aaron Birkland

(tick) Windows 10

Manual Tests

All of the below should take place in the HTML UI and non-vagrant tests should run against fcrepo-webapp-plus.

  1. Create nested containers
  2. Create binary resources
  3. Run fixity on binary
  4. Update Properties:  Perform SPARQL-Update on container
  5. Update Properties:  Perform SPARQL-Update on binary
  6. Delete container
  7. Delete binary
  8. Use transactions
  9. Create versions
  10. View versions
  11. Rollback versions

Database Tests

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

DatabasePlatformTested bySuccess? RC-1Notes
MySQL

5.7.17

Andrew Woods

(tick)

fcr:backup/fcr:restore Functionality

These tests are designed to ensure the proper function of the 'fcr:backup/fcr:restore' features by testing them against various Fedora configurations.  The validity of the 'restore' can only be determined by crawling the repository and verifying the successful retrieval of the repository's content.

If the anticipated Fedora release is not backwards compatible with the previous version of Fedora, then the "From Fedora Version" should be the previous version.  Otherwise, it is sufficient to test the fcr:backup/fcr:restore functionality using the same version.

See: RESTful HTTP API - Backup and Restore

# Backup
curl -X POST localhost:8080/rest/fcr:backup
 
# Restore
curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore

Resources

 

Tested byPlatform

Container

(Tomcat/Jetty)

Database

Backend

From Fedora
Version

To Fedora
Version

Number of

RDF Resources

Number of

Binaries

Size of Backup (du -h .)Success?Notes                  

Andrew Woods

LinuxTomcat8MySQL 14.14 Distrib 5.7.174.7.2-RC14.7.2-RC110010055G(tick)Used plantpatents dataset 

NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages. 

Vagrant Tests

vagrant destroy
vagrant up


Test stepsTested bySuccess? RC-1Notes

FEDORA_AUTH=true
FEDORA_AUDIT=true

Andrew Woods

(tick)


FEDORA_AUTH=false
FEDORA_AUDIT=true


Andrew Woods

(tick)

 

FEDORA_AUTH=true
FEDORA_AUDIT=false

Andrew Woods

(tick)

 

FEDORA_AUTH=false
FEDORA_AUDIT=false


Andrew Woods

 (tick) 

Manual Tests

Same as above, plus:

  1. Verify audit events are in triplestore
  2. Verify resources are in triplestore
  3. Verify resources are in Solr
  4. Verify authorization works for the two auth-enabled configurations
  5. Verify reindexing to triplestore works

[1] Testing scripts

[2] Fedora 4 Release Test Suite