You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 14 Next »

Issues found during testing

  • RC-1

External Projects

Hydra

ProjectTested bySuccess? RC-1Notes
ActiveFedora(tick)
CurationConcerns


 
HyraxEsmé Cowles(tick)
Plum
 
Sufia
 

 

Islandora

 ProjectTested bySuccess? RC-1Notes
CLAW
 

Testing Plan

git clone https://github.com/fcrepo4/fcrepo4
cd fcrepo4
git checkout 4.7.2-RC

Sanity Builds

ProjectCommandPlatformTested bySuccess? RC-1Notes
fcrepo4mvn clean install

linux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo4mvn clean install mac (tick)macOS 10.11.6
fcrepo4mvn clean installwindowsAaron Birkland(tick)Windows 10
fcrepo-module-auth-rbaclmvn clean installlinux

(tick)

(tick)

 

Ubuntu 16.10

Ubuntu 16.04

fcrepo-module-auth-rbaclmvn clean install mac(tick)macOS 10.11.6
fcrepo-module-auth-rbaclmvn clean installwindowsAaron Birkland(tick)Windows 10
fcrepo-module-auth-xacmlmvn clean install linux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04 

fcrepo-module-auth-xacmlmvn clean install mac(tick)macOS 10.11.6
fcrepo-module-auth-xacmlmvn clean installwindowsAaron Birkland(tick)Windows 10
fcrepo-module-auth-webacmvn clean install linux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo-module-auth-webacmvn clean install mac(tick)macOS 10.11.6
fcrepo-module-auth-webacmvn clean installwindows(tick)Windows 10
fcrepo-mintmvn clean install linux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

 
fcrepo-mintmvn clean install mac(tick)macOS 10.11.6
fcrepo-mintmvn clean installwindows(tick)Windows 10
fcrepo-auditmvn clean install linux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

 
fcrepo-auditmvn clean install mac(tick)macOS 10.11.6
fcrepo-auditmvn clean installwindows(tick)Windows 10
fcrepo-webapp-plusmvn clean install linux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo-webapp-plusmvn clean install mac(tick)macOS 10.11.6
fcrepo-webapp-plusmvn clean install windowsAaron Birkland(tick)Windows `0
fcrepo-webapp-plusmvn clean install -Prbacl linux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo-webapp-plusmvn clean install -Prbaclmac(tick)macOS 10.11.6
fcrepo-webapp-plusmvn clean install -Prbaclwindows(tick)Windows 10
fcrepo-webapp-plusmvn clean install -Pxacmllinux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

fcrepo-webapp-plusmvn clean install -Pxacmlmac(tick)macOS 10.11.6
fcrepo-webapp-plusmvn clean install -PxacmlwindowsAaron Birkland(tick)Windows 10

One-Click Run

cd fcrepo-webapp; mvn clean install -Pone-click
CommandPlatform Tested bySuccess?  RC-1Notes
java -jar fcrepo-webapp-<version>-jetty-console.jar Linux

(tick)

(tick)

Ubuntu 16.10

Ubuntu 16.04

java -jar fcrepo-webapp-<version>-jetty-console.jarMac

 

java -jar fcrepo-webapp-<version>-jetty-console.jar

Windows(tick) Windows 10

Manual Tests

All of the below should take place in the HTML UI and non-vagrant tests should run against fcrepo-webapp-plus.

  1. Create nested containers
  2. Create binary resources
  3. Run fixity on binary
  4. Update Properties:  Perform SPARQL-Update on container
  5. Update Properties:  Perform SPARQL-Update on binary
  6. Delete container
  7. Delete binary
  8. Use transactions
  9. Create versions
  10. View versions
  11. Rollback versions

Database Tests

With Tomcat7 deployment, run above manual tests with alternate backend databases (Configuring JDBC Object Store)

DatabasePlatformTested bySuccess? RC-1Notes
MySQL

5.6.34 MySQL Community Server (GPL) (rh-mysql56) on RHEL 7.3

Jim Coble 
PostgreSQLPostgres9.4 on Docker  

fcr:backup/fcr:restore Functionality

These tests are designed to ensure the proper function of the 'fcr:backup/fcr:restore' features by testing them against various Fedora configurations.  The validity of the 'restore' can only be determined by crawling the repository and verifying the successful retrieval of the repository's content.

If the anticipated Fedora release is not backwards compatible with the previous version of Fedora, then the "From Fedora Version" should be the previous version.  Otherwise, it is sufficient to test the fcr:backup/fcr:restore functionality using the same version.

See: RESTful HTTP API - Backup and Restore

# Backup
curl -X POST localhost:8080/rest/fcr:backup
 
# Restore
curl -X POST -d "/path/to/backup/directory" localhost:8080/rest/fcr:restore

Resources

  • These python scripts - fcrepo-testing - can be used to load RDF content and binary content to a Fedora repository and verify the integrity of the loaded resources.  Output from the load process can be used to verify the integrity of a 'restored' repository.  See the README for more info.
  • This script can be used to walk your repository, failing if a non-success response is encountered.

 

Tested byPlatform

Container

(Tomcat/Jetty)

Database

Backend

From Fedora
Version

To Fedora
Version

Number of

RDF Resources

Number of

Binaries

Size of Backup (du -h .)Success?Notes                  
LinuxTomcat (7.0.72)Postgres (9.4)4.6.14.7.2-RC1461,5681,67148G
 
MacJetty (Standalone) 4.7.2-RC125,6000 
 
MacJetty (Standalone) 4.7.2-RC14.7.2-RC112,80012,80013GB
 
MacJetty (Standalone) 4.7.2-RC14.7.2-RC112,80012,80013GB       
DockerTomcat7Postgres 9.44.7.2-RC14.7.2-RC125,60003.8M       
DockerTomcat7Postgres 9.44.7.2-RC14.7.2-RC1256025602.7G       
LinuxTomcat (7.0.72)Postgres 9.44.6.14.7.2-RC1461,5681,67148G       

NB: "Success" is measured not by receiving a "204 No Content" message after the 'fcr:restore' command, but by performing a GET on every resource in the repository and receiving "200 OK" messages.

Multi-thread Tests

These tests are designed to ensure the integrity of the repository when loading content in a multi-threaded fashion.  Testing for repository corruption should entail confirming the successful load of resources, the successful fetching of resources, and the successful deletion of resources. Prior to 4.6.1, these tests would result in repository corruption.

Resources

  • These python scripts - fcrepo-testing - can be used to load RDF content and binary content to a Fedora repository and verify the integrity of the loaded resources.  See the README for more info.

 

Tested byPlatform

Container

(Tomcat/Jetty)

Database

Backend

Number of

Threads

Number of

RDF Resources

Number of

Binaries

Success? RC-1Notes                  
MacJetty (Standalone) 212,80012,799

 MacJetty (Standalone) 812,80012,706

 MacJetty (Standalone) 825,6000
 
MacJetty (Standalone) 825,6000  
DockerTomcat7Postgres9.4825,6000  
DockerTomcat7Postgres9.4425602560  

NB: "Success" is measured by receiving all 200s when performing a GET on each loaded resource, and all 204s when finally deleting the content.

Vagrant Tests

vagrant destroy
vagrant up
Test stepsTested bySuccess? RC-1Notes

FEDORA_AUTH=true
FEDORA_AUDIT=true



FEDORA_AUTH=false
FEDORA_AUDIT=true



 

FEDORA_AUTH=true
FEDORA_AUDIT=false


 

FEDORA_AUTH=false
FEDORA_AUDIT=false

  

Manual Tests

Same as above, plus:

  1. Verify audit events are in triplestore
  2. Verify resources are in triplestore
  3. Verify resources are in Solr
  4. Verify authorization works for the two auth-enabled configurations
  5. Verify reindexing to triplestore works

[1] Testing scripts

[2] Fedora 4 Release Test Suite

  • No labels