How to Conduct Performance Tests and Share Results

Prerequisites

1.  Download and install jmeter: http://jmeter.apache.org

   1. Ubuntu 16.04 LTS: installjmeter.sh

      #!/bin/bash
      
      # get source from an apache mirror
      wget http://supergsego.com/apache//jmeter/binaries/apache-jmeter-3.1.tgz
      # verify the md5
      
      local_md5=`md5sum apache-jmeter-3.1.tgz | cut -f 1 -d ' '`
      remote_md5=`curl https://www.apache.org/dist/jmeter/binaries/apache-jmeter-3.1.tgz.md5 | cut -f 1 -d ' '`
      
      if [ "$local_md5" != "$remote_md5" ]
      then
        echo "md5's do not match"
        exit
      else
        echo "congratulations md5s match"
      fi
      
      # untar it.
      tar xvfz apache-jmeter-3.1.tgz
      # move it
      sudo mv apache-jmeter-3.1 /usr/local/apache-jmeter-3.1
      # link it
      sudo ln -s /usr/local/apache-jmeter-3.1/bin/jmeter /usr/bin/jmeter
      
      

Instance Setup

1. Instance Specs
   1. OS (type and version)
   2. Processor Speed
   3. Number of Cores
   4. Disk Type (SSD or Hard Disk)
   5. RAM
   6. IOPS (if applicable)
   7. any java configuration options (e.g. -Xmx 2G)
   8. binary configuration:  local,  network,  S3
   9. is virtual or physical?
   10. is test runner on the same machine? 
2. Database Specs (Using JDBC object store)
   
   1. type (mysql, postgresql, aurora, etc)
   2. if using a remote database
      1. processor speed
      2. processor count
      3. RAM
      4. if RDS,  RDS type (e.g. db1.small)

Fedora 4 setup 

1. Installation: 
   1. Fedora 4 Quick Start
   2. Deploying Fedora 4 Complete Guide
   3. Database: Configuring JDBC Object Store 
   4. Fedora 4 Ansible script: https://github.com/VTUL/fcrepo4-ansible
2. Fedora version  (Start from 4.7.3)
3. Is using a database? (local or remote) 

Generate Test Data 

1. Download the test scripts and read the README (https://github.com/fcrepo4-labs/fcrepo4-jmeter)

   git clone https://github.com/fcrepo4-labs/fcrepo4-jmeter.git

2. Run a test. See each test JMeter command in README.  For example, below code block is Test 4 JMeter command: 

   jmeter -Dfedora_4_server=SERVERIP -Dfedora_4_port=PORT -Dfedora_4_context=fcrepo/rest -Dcontainer_threads=1 -n -t /path/to/fcrepo4-jmeter/fedora.jmx 

Generate Graphs Based  on Your Test Data

1. Clone the Performance Analysis Project

   git clone https://github.com/fcrepo4-labs/fcrepo_perf_analysis.git

2. Download and install the latest version of R https://www.r-project.org/

   1. Ubuntu 16.04 LTS: installr.sh

3. Follow steps outlined in https://github.com/fcrepo4-labs/fcrepo_perf_analysis

   1. dbernstein:  I was unable to get past the column checking step 

      Rscript 01-check-jmeter-log.r ~/code/performance-tests/2017-03-16/log/perf.log 
      Header check:
      Expected: 12 encountered: 10 
      [1] "Unexpected number of input fields!"

Share Your Results with the Community

•       Performance Test Result template