Testers may either put their results directly in this wiki page, or in the testing Google spreadsheet.


Testing Blocker Tickets

None

Testing Plan

Prepare installation (build from source)

git clone https://github.com/vivo-project/Vitro.git Vitro
git clone https://github.com/vivo-project/VIVO.git VIVO


cd Vitro
git checkout rel-1.10.0-RC-1

cd ../VIVO
git checkout rel-1.10.0-RC-1


cp ./installer/example-settings.xml local-settings.xml
# Update local-settings.xml with appropriate `vivo-dir` and `tomcat-dir`

Sanity Builds

CommandPlatformTested bySuccess?Notes

mvn clean install -s local-settings.xml

Linux(tick)Built from source

mvn clean install -s local-settings.xml

Mac

Mac

(tick)

(tick)

Built from source

mvn clean install -s local-settings.xml

Mac

Linux

Mac

(tick) 


(tick)

Built from distribution

mvn clean install -s local-settings.xml

Windows(tick)Built from source

New Installation Tests

  1. Prepare installation, see above
  2. Empty MySQL database

    mysql -u root -p
    mysql> drop database vitrodb
    mysql> CREATE DATABASE vitrodb CHARACTER SET utf8;
    mysql> GRANT ALL ON vitrodb.* TO 'vitrodbUsername'@'localhost' IDENTIFIED BY 'vitrodbPassword';
  3. Remove application data

    rm -rf ${VIVO_HOME}/tdbModels/*
    rm -rf ${VIVO_HOME}/solr/data/*
  4. Start Tomcat

    sudo service tomcat8 restart

UI Tests


TestPlatformTested bySuccess?Notes
1

Smoke tests do not produce error

(warning about email server is OK)

Mac

Linux

Windows

Win/Lnx

(tick)

(tick)

(tick)

(tick)


2

Home page displays correctly

Mac

Linux

Win/Lnx

(tick) 

(tick)

(tick)

Wait for indexing, refresh.
3Log in as admin

Mac

Linux

Win/Lnx

(tick) 

(tick)

(tick)


4Site Admin page displays correctly

Mac

Linux

Win/Lnx

(tick) 

(tick)

(tick)

Shows startup status warning re email
5Each function on site admin display correctly

Mac


Win/Lnx

(tick) 

(tick)

(tick)

All 24 links (including Data Input Pull down) display normally. Ontology list All looks good
6

Site Admin - Add Individual of this class:

Faculty Member (People)

Project (Activities)

Course (Courses)

Academic Article (Research)

Presentation (Events)

Academic Department (Organizations)

Populated Place (Locations)

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed
7Check required fields in creating classesMac(tick)

 

Not sure what this test is? VIVO only requires labels as individuals are created.
8

Check menu entries

(Home, People, Organizations, Events, Capability Map)

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed.
9

Check Person display

(logged out, logged in)

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed.
10Add values to all Person attributesMac(tick)

 

All is a heavy lift. 64 attributes accessible from the person page, some of which lead to entities (publications, positions, etc)) each with their own attributes.

Recommended: Add photo, overview, URL, research areas, position. Each exercises different functionality.

11Add research areas using vocabulary servicesMacUnable to complete

UMLS service requires registration key. See Release Notes. Unclear where this key would go. Other services respond as expected.

BG: Created Jira issue for UMLS Unable to locate Jira server for this macro. It may be due to Application Link configuration.

12

Check tabs on Person display

(overview, publications, contact, etc.)

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed.
13

Add new publication to person

(check required fields)

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed.
14Check publication sparklineMac

(tick)

(tick)

Works as designed.


^^^ confirmed. This may have been broken for awhile. The link doesn't work on Scholars@Duke either.

Was I going crazy? It works.

15

Check manage publications

(hide / show publications)

Mac

Linux

(tick)

(tick)

Works as designed. (I don't think I'd ever tried this. Works well.)
16

Check Publication view

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed.
17

Check AltMetric badge

(e.g. doi: 10.1038/nrmicro2331)

Mac

Win/Lnx

(tick)

 (tick)

Poor UI experience. I copied in the link, which copied in the HTML tagging, which led to showing the HTML tagging in the display. The edit form is open ended HTML, should be plain text. Should indicate what form of DOI is expected , or should accept with or without http:// without without "doi".
18Add author(s) to publication

Mac

Linux

Win/Lnx

(tick)

(tick) 

(tick)

Works as designed.
19Check Person has co-author network

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed.
20Check co-author network display

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed
21Add grants to Person

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed
22Add co-investigators to grants

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed
23Check Person has co-investigator network

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed
24Check co-investigator network display

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

Works as designed
25Load Sample Data

Mac

Linux

(tick)

 (tick)

sample-data.n3 loaded from https://github.com/vivo-project/sample-data/blob/master/sample-data.n3
26Check Capability Map

Mac

Linux

(tick)

 (tick)

Works as designed. Need more sample data with more concepts for more extensive tests.
27Check Map of Science

Mac


Win/Lnx

Unable to complete


⚠️

Testing requires google maps key configured in runtime.properties.


Works. Info popups work but top two are buggy, want to disappear quickly and link in popup is impossible to click. Also seeing different numbers in CSV export for Disciplines vs what is shown in table on page. Subdiscipline csv export numbers look okay.

28Check Temporal Graph

Mac

Linux

(tick)

 (tick)

(tick)

Works as designed
29Search for "Derrida"

Mac

Linux

(tick)

(tick)

(tick)

Works as designed
30Check index page

Mac

Linux

Win/Lnx

(tick)

(tick)

(tick)

 

Works as designed
31Create self editor login associated with profile

Mac


(tick)
(tick)
Works as designed. Updated documentation to describe how this is done. See Creating and Managing User Accounts#AssociatingUserAccountswithProfilePages
32Log in as self editor. Verify can edit self, cannot edit others.Mac(tick)(tick)

 

Works as designed.
33Add and confirm an ORCiDMacUnable to completeORCiD API configuration requires clientId and clientPassword and public VIVO. See Activating the ORCID integration
34Create editor and assign proxy editing

Mac

Windows

(tick)

(tick)

(tick)

Works as designed.

Created user account with editor role and assigned proxy editing.  Also switched to self-editor role.

35Log in as proxy editor. Verify can edit proxied profile, cannot edit others.

Mac


Windows

(tick)


(tick)


(tick) 

works as designed.


When logged in as self-editor designated as a proxy editor, I can only edit the proxied profile and not a different profile.  When logged in as editor (i.e. the editor role which is different from self-editor), I can edit the proxied profile but also other profiles. Works as it should.

36Check TPF endpoint

Mac

Windows

(tick)

(tick)

(tick)

Works as designed. 45,279 triples with VIVO data, sample data, and some manually entered test data. Design needs work.

/tpf/core displayed triples and enabled triple pattern matching by subject,predicate, or object.  (43,173 triples in total)

37Run a SPARQL query

Mac



Windows

(error) Test failed



(tick)





(tick)

Chrome: Screen appeared to be showing all prefixes, then flashed and was replaced by screen showing just five prefixes. Query ran fine, but prefixes should appear in the default SPARQL query window. See SPARQL Prefixes missing 2018-06-03 14.50.25.png May be user error – perhaps caching this screen? I removed all cache and retried, but behavior remained.

Note from Benjamin Gross: Re: Above... I'm not sure what the mechanism for caching is, but I think that's what is happening. I got all the normal prefixes the first time as expected.

Safari: works as designed

On Windows, tested in Firefox with same query as in screenshot above: "PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> SELECT ?s ?o WHERE {?s rdfs:subClassOf ?o .}" and items were returned. In Chrome, ran default query that shows up when you first to the Sparql query page (if you haven't been there in that browser) and that also ran successfully.

API Tests (reference: VIVO APIs)


TestPlatformTested bySuccess?Notes
1

Linked Open Data

Linux

(tick)







(tick)

# From Site Admin: Create a new `Faculty Member` (Add individual)
** Record the new URI: http://localhost:8080/vivo/individual/n1323
# Verify `individual` endpoint:

curl http://localhost:8080/vivo/individual/n1323/n1323.ttl
curl http://localhost:8080/vivo/individual/n1323/n1323.n3
curl http://localhost:8080/vivo/individual/n1323 -L -H "Accept: text/turtle"

for windows using cURL for Windows 7.46


ListRDFLinux

(tick)

(tick)

curl http://localhost:8080/vivo/listrdf -d 'vclass=http://vivoweb.org/ontology/core#Continent'

for windows using cURL for Windows 7.46 (doesn't want the single quote)

curl http://localhost:8080/vivo/listrdf -d vclass=http://vivoweb.org/ontology/core#Continent

3

Triple Pattern Fragments

http://localhost:8080/vivo/tpf/core

http://localhost:8080/vivo/tpf

curl http://localhost:8080/vivo/tpf/core

Linux(tick)

# Verify browsing:
http://localhost:8080/vivo/tpf/core
http://localhost:8080/vivo/tpf

# Verify direct access:
curl http://localhost:8080/vivo/tpf/core?subject=http://localhost:8080/vivo/individual/n1323

4SPARQL Query APILinux(tick)

Enabled service

Executed several queries (both root and site-admin):

curl -i localhost:8080/vivo/api/sparqlQuery -d email=us -d password=pw -d query='SELECT ?s ?p ?o WHERE {<http://localhost:8080/vivo/individual/n1323> ?p ?o} LIMIT 20'

curl -i localhost:8080/vivo/api/sparqlQuery -d email=us -d password=pw -d query='DESCRIBE <http://dbpedia.org/resource/Connecticut>' -H 'Accept: text/n3'
5SPARQL Update APILinux(tick)Success with examples on: SPARQL Update API
6Search Indexing APILinux(tick)Service returns success status, with "Received 1 URIs."
7Data Distribution APILinux(tick)

(error) Documentation needs to include updating the pom.xml ( Unable to locate Jira server for this macro. It may be due to Application Link configuration. )

Followed directions here: https://cul-it.github.io/vivo-data-distribution-api/install_vivo_1_10.html

8Direct2Experts API

Linux

Mac

(question)

(tick)

(error) No documentation Direct2Experts API

Done writing. Review here:

Unload/Load Tests


TestPlatformTested bySuccess?Notes
1Load data using the HarvesterLinux

(error) Build failed

Builds failed

$ mvn clean install
$ Tests run: 97, Failures: 0, Errors: 25, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:09 min
[INFO] Finished at: 2018-06-29T14:24:13-04:00
[INFO] Final Memory: 49M/444M
$ mvn clean install -DskipTests
$ Caused by: java.io.FileNotFoundException: Data source not found : /home/awoods/programming/java/apps/vivo/VIVO-Harvester/build/dependency
        at org.vafer.jdeb.maven.Data.produce(Data.java:98)
        at org.vafer.jdeb.Processor.buildData(Processor.java:515)
        at org.vafer.jdeb.Processor.createDeb(Processor.java:128)
        ... 24 more
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 12.195 s
[INFO] Finished at: 2018-06-29T14:25:54-04:00
[INFO] Final Memory: 51M/471M
2

Unload using jena2tools -e

(using jena3tools -e Andrew Woods )

Windows | Linux

(tick)

(tick)


3Load using jena3tools -iWindows | Linux

(tick)

(tick)


4Load sample data to a named graphWindows | LinuxRalph O'Flinn(tick)
5Remove sample data named graphWindows | LinuxRalph O'Flinn(tick)

Upgrade Tests

  1. Install previous release
  2. Prepare installation per instructions above for previous release
  3. Start Tomcat - check that smoke test passes
  4. Stop Tomcat
  5. Export data with jena2tools

    java -jar jena2tools.jar -e -d /usr/local/vivo/home
  6. Empty MySQL

    mysql -u root -p
    mysql> drop database vitrodb;
    mysql> CREATE DATABASE vitrodb CHARACTER SET utf8;
    mysql> GRANT ALL ON vitrodb.* TO 'vitrodbUsername'@'localhost' IDENTIFIED BY 'vitrodbPassword';
  7. Remove application data

    rm -rf ${VIVO_DIR}/tdbModels/*
    rm -rf ${VIVO_DIR}/solr/data/*
  8. Import data with jena3tools

    java -jar jena3tools.jar -i -d /usr/local/vivo/home
  9. Start Tomcat
  10. Verify application per `UI Tests` above

    TestPlatformTested bySuccess?Notes
    All UI TestsWindows | LinuxRalph O'Flinn(tick)
    All API TestsWindows | LinuxRalph O'FlinnIn Progress
    All Unload/Load testsWindows | LinuxRalph O'Flinn(tick)(except Harvester)
    All performance tests



Vagrant Tests

  1. Clone VIVO Vagrant

    git clone https://github.com/vivo-community/vivo-vagrant.git
  2. Checkout release candidate 

    cd vivo-vagrant
    git checkout rel-1.10.0-RC-1
  3. Load local or sample data

  4. Verify application per `UI Tests` above
TestPlatformTested bySuccess?Notes
All UI TestsLinux | Mac | Windows


All API Tests



All Unload/Load Tests
(tick)(tick)
All performance tests



Performance Tests

Performance tests should compare run times for a 1.9.3 vs a 1.10 on same hardware, same data.
Timing collection may be facilitated by enabling The Developer Panel.


TestPlatformTested bySuccess?Notes
1Compare firsttime starttime timeLinux | Mac | Windows


2Compare performance data load time



3Compare profile display time



4Compare SPARQL query time



5Compare Search Index rebuild time



6Compare Inferencer rebuild time



7Compare jenatools export time



8Compare jenatoools import time



9Compare Data Distribution API response time



  • No labels