OpenKWS13 Dry Run Instructions

The following is the OpenKWS Evaluation Infrastructure setup and testing instructions

1. Download the Babel-Formated, Spoken Term Detection data (if requested) with the URL provided by NIST to the registered POC email. 
2. Download the latest IndusDB 20130402 URL: https://control.nist.gov/indus/OpenKWS13/IndusDB.20130402.OpenKWS.e61f427d714d2df990c3f8cca505cf38.tar.bz2
3. Download and install SCTK Version 2.4.7 or later (from http://www.nist.gov/itl/iad/mig/tools.cfm) according to the INSTALL document in the distribution.
4. Download JobRunner 1.2.1 or later (from http://www.nist.gov/itl/iad/mig/tools.cfm) 
5. Download and check the F4DE 2.5.1 or later (from http://www.nist.gov/itl/iad/mig/tools.cfm) according to the instructions under "INSTALLATION" section in the"README" file of the distribution.  
6. • Note, F4DE requires many CPAN libraries and other utilities.  It is vital that a you successfully run either the full "make check" or minimally the 'make mincheck' and 'make KWSEvalcheck' before proceeding to Step 7.
7. Send NIST Information to set up your Indus Scoring Server account which uses SSH public/private keys for authentication. (Instructions summarized from the "KWSEval/BABEL/Participants/README" in the F4DE release).
8. 1. If not familiar with SSH, please see: http://www.wikihow.com/Use-SSH
   2. Decide on the user name of your team; it must follow the pattern "kws-<TEAM>[_<SITE>]" (<TEAM> or <SITE> can not contain - or _)
   3. Generate an SSH Protocol 2 Key: Either ensure you have a valid SSH Protocol 2 public/private keys or generate a pair using either '% ssh_keygen -t dsa' or '% ssh_keygen -t rsa' with a non empty passphrase of 12 or more characters.
   4. email 'indus [at] nist.gov ('indus at nist.gov)' with the following:
   5. 1. your user, site and team names
      2. the list of users expected to use the service with contact information (email + phone)
      3. Attach your public key (not inline text) to the email.
      4. Send a list of the IP subnets that will need access to the ssh Indus serve
9. After completing step 5 and receiving your Indus Account, follow the Indus Scorer Setup instructions  found in "KWSEval/BABEL/Participants/README" of the  F4DE release.
10. Run the test submissions through the scoring server by:
11. 1. Change directory to the KWSEval/BABEL/Participants/Checks directory
    2. Execute: "./SubmissionHelper_checks.sh ../KWS13-dbDir/Comp*"
12. Unpacked password-protected zip file (TestData.zip) to make sure you can read the delivered data. The password is "abc123". The file listing should be:

TestData
TestData/dir1
TestData/dir1/subdir1
TestData/dir1/subdir1/Readme.txt
TestData/dir2
TestData/TopReadme.txt