Testing Blocker Tickets

  1. RC-1

External Projects

  • Hydra

ProjectTested BySuccess?Notes
ActiveFedora(tick)
CurationConcernsEsmé Cowles*1 test failure, but same failure seen with 4.7.1, 4.7.1-RC-1 and 4.6.1
Hyrax(tick)
Plum(tick)
SufiaEsmé Cowles(tick)

 

  • Islandora

Testing Plan

git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout 4.6.2-RC

Sanity Builds

ProjectCommandPlatformTested bySuccess?Notes
fcrepo4mvn clean install

linux

 (tick)
 (tick)

 Ubuntu 16.10

 Ubuntu 16.04

fcrepo4mvn clean install 

mac 

Jonathan Dixon(tick)

MacOS 10.12.2

fcrepo4mvn clean installwindowsAaron Birkland (tick) Windows 10
fcrepo-module-auth-rbaclmvn clean installlinux

(tick)

(tick)

 Ubuntu 16.10

 Ubuntu 16.04

fcrepo-module-auth-rbaclmvn clean install mac(tick)

MacOS 10.12.2

fcrepo-module-auth-rbaclmvn clean installwindows(tick)  Windows 10
fcrepo-module-auth-xacmlmvn clean install linux

(tick)

(tick)

 Ubuntu 16.10

 Ubuntu 16.04

fcrepo-module-auth-xacmlmvn clean install mac(tick)

MacOS 10.12.2

fcrepo-module-auth-xacmlmvn clean installwindows(tick)  Windows 10
fcrepo-module-auth-webacmvn clean install linux

(tick)

(tick)

 Ubuntu 16.10

 Ubuntu 16.04

fcrepo-module-auth-webacmvn clean install mac(tick)

MacOS 10.12.2

fcrepo-module-auth-webacmvn clean installwindows (tick) Windows 10
fcrepo-mintmvn clean install linuxNick Ruest

(tick)

(tick)

 Ubuntu 16.10

 Ubuntu 16.04

 
fcrepo-mintmvn clean install mac(tick)

MacOS 10.12.2

fcrepo-mintmvn clean installwindows(tick)  Windows 10
fcrepo-auditmvn clean install linux

(tick)

(tick)

 Ubuntu 16.10

 Ubuntu 16.04

fcrepo-auditmvn clean install mac(tick)

MacOS 10.12.2

fcrepo-auditmvn clean installwindows(tick) Windows 10
fcrepo-webapp-plusmvn clean install linux

(tick)

(tick)

 Ubuntu 16.10

 Ubuntu 16.04

fcrepo-webapp-plusmvn clean install mac(tick)

MacOS 10.12.2

fcrepo-webapp-plusmvn clean install windows(tick)  Windows 10
fcrepo-webapp-plusmvn clean install -Prbacl mac(tick)

MacOS 10.12.2

fcrepo-webapp-plusmvn clean install -Prbaclwindows (tick) Windows 10
fcrepo-webapp-plusmvn clean install -PrbacllinuxNick Ruest

(tick)

(tick)

 Ubuntu 16.10

 Ubuntu 16.04

fcrepo-webapp-plusmvn clean install -Pxacmlmac(tick)

MacOS 10.12.2

fcrepo-webapp-plusmvn clean install -Pxacmlwindows (tick) Windows 10
fcrepo-webapp-plusmvn clean install -Pxacmllinux

(tick)

(tick)

 Ubuntu 16.10

 Ubuntu 16.04

 

Filesystem Federation

Test simple federation

Tested by
Platform
Success?
Notes
Linux(tick)

Deployed core war with file-connector repository.json


Mac

One-Click Run

cd fcrepo-webapp; mvn clean install -Pone-click
CommandPlatform Tested bySuccess? Notes
java -jar fcrepo-webapp-4.6.2-SNAPSHOT-jetty-console.jar Linux

(tick)

(tick)

Ubuntu 16.10 

Ubuntu 16.04

java -jar fcrepo-webapp-4.6.2-SNAPSHOT-jetty-console.jarMac



 

java -jar fcrepo-webapp-4.6.2-SNAPSHOT-jetty-console.jar

Windows Aaron Birkland (tick) Windows 10

Manual Tests

All of the below should take place in the HTML UI and non-vagrant tests should run against fcrepo-webapp-plus.

  1. Create nested containers
  2. Create binary resources
  3. Run fixity on binary
  4. Update Properties:  Perform SPARQL-Update on container
  5. Update Properties:  Perform SPARQL-Update on binary
  6. Delete container
  7. Delete binary
  8. Use transactions
  9. Create versions
  10. View versions
  11. Rollback versions

Database Tests

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

DatabasePlatformTested bySuccess?Notes
MySQL5.7.17(tick)

 

PostgreSQL9.3.15

 

fcr:backup/fcr:restore Functionality

These tests are designed to ensure the proper function of the 'fcr:backup/fcr:restore' features by testing them against various Fedora configurations.  The validity of the 'restore' can only be determined by crawling the repository and verifying the successful retrieval of the repository's content.

If the anticipated Fedora release is not backwards compatible with the previous version of Fedora, then the "From Fedora Version" should be the previous version.  Otherwise, it is sufficient to test the fcr:backup/fcr:restore functionality using the same version.

See: RESTful HTTP API - Backup and Restore

# Backup
curl -X POST localhost:8080/rest/fcr:backup
 
# Restore
curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore

Resources

  • These python scripts - fcrepo-testing - can be used to load RDF content and binary content to a Fedora repository and verify the integrity of the loaded resources.  Output from the load process can be used to verify the integrity of a 'restored' repository.  See the README for more info.
  • This script can be used to walk your repository, failing if a non-success response is encountered.

 

Tested byPlatform

Container

(Tomcat/Jetty)

Database

Backend

From Fedora
Version

To Fedora
Version

Number of

RDF Resources

Number of

Binaries

Size of Backup (du -h .)Success?Notes                  
LinuxTomcat 8MySQL Ver 14.14 Distrib 5.7.174.6.24.6.210010055M(tick)Used plantpatents dataset

NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages.

Vagrant Tests

vagrant destroy
vagrant up
Test stepsTested bySuccess?Notes

FEDORA_AUTH=true
FEDORA_AUDIT=true

(tick)Using: https://github.com/whikloj/fedora4-tests

FEDORA_AUTH=false
FEDORA_AUDIT=true

(tick)

Using: https://github.com/whikloj/fedora4-tests

FEDORA_AUTH=true
FEDORA_AUDIT=false

(tick)Using: https://github.com/whikloj/fedora4-tests

FEDORA_AUTH=false
FEDORA_AUDIT=false

(tick)Using: https://github.com/whikloj/fedora4-tests

Manual Tests

Same as above, plus:

  1. Verify audit events are in triplestore
  2. Verify resources are in triplestore
  3. Verify resources are in Solr
  4. Verify authorization works for the two auth-enabled configurations
  5. Verify reindexing to triplestore works

[1] Testing scripts

[2] Fedora 4 Release Test Suite

  • No labels