Ballista OS Robustness Test Suite - Reporting Results

You are welcome to submit your results for inclusion in the list of Ballista OS Robustness Test Suite results. Submission of results is completely voluntary. If you choose to submit your results there are two separate steps: consolidation of results, and mailing of results.

Consolidation

Consolidation of results is done by running the perl script consolidate.pl in the .../ballista directory.

> perl consolidate.pl

The purpose of the consolidate.pl perl script is to gather information about

The result of running consolidate.pl is the file consolidate.tar.gz.uu. This file is not automatically mailed. When you are executing consolidate.pl you will be prompted to answer several questions. An outline of the questions follow. The text displayed depends on the system state with all possible questions illustrated below:


HEADING

Thank you for choosing to report your Ballista OS Robustness test results.
If you choose to cancel the reporting you may do so by entering <Ctrl-C> at any time.
The results are actually sent (by you) in a separate step.

 (if consolidate.pl has been run before)
It appears that you have previously consolidated your results. If you wish to save the prior consolidation then type "NO", copy the consolidate subdirectory to another location, and restart the script. Otherwise your prior consolidation will be deleted.
Continue consolidation? <Yes/No>

(if you answer No then consolidation will halt)
(otherwise)
Cleaning up previous consolidation...

CATASTROPHIC INFORMATION

(if no catastrophic functions were found commented out with #CAT in callTable.all)
Did you encounter any catastrophic errors when executing the test suite?
(Did the system crash when running the test suite?) <Yes/No>
(if you answer Yes)
Please list the functions that produced catastrophic errors. (Enter a single period (".") on a line to indicate the end of the function list.)
(otherwise - catastrophics detected)
Based on callTable.all the following functions appear to produce catastrophic errors:
... list of functions ...
Are there additional functions that produced catastrophics or comments about the above functions you wish to add. <Yes/No>
 (if you answer Yes)
Please report any additional functions producing catastrophic errors or add comments about the above catastrophic errors. (Enter a single period (".") on a line to indicate the end of the function list.)

SYSTEM INFORMATION

(if system information can be determined using the uname command)
The following system information has been recorded:
... system information ...
(otherwise)
Problems encountered trying to gather system information.
Command uname -rsvm returned unsuccessfully.
Please report the following system information:
  • operating system under test (e.g. Linux)
  • operating system release (e.g. 2.2.16-22smp)
  • operating system version (e.g. \#1 SMP Tue Aug 22 16:39:21 EDT 2000)
  • machine (hardware) type (e.g. i686)
Is there additional system or machine information you wish to record? <Yes/No>
(if you answer Yes)
Please report any additional system or machine information.
(Enter a single period (".") on a line to indicate the end of the information.)

CONFIGURATION INFORMATION

Are there any changes you made to the system configuration that are likely to affect the results? <Yes/No>
 (if Yes)
Please enter additional system configuration information.
(Enter a single period (".") on a line to indicate the end of the information.)

COMPILER VERSION

(if able to determine the compiler version)
The compiler version was determined to be:
... compiler version information ...
Would you like to add an additional compile information? <Yes/No>
 (if Yes)
(Enter a single period (".") on a line to indicate the end of the compiler version information.)
(if unable to determine the compiler version)
A descriptive message stating where the difficulty in determining the compiler version occurred.
Please specify compiler version:
(Enter a single period (".") on a line to indicate the end of the compiler version information.)

TEMPLATE CHANGES

Did you make any changes to the ballista datatype template files? (These files have the .tpl suffix) <Yes/No>

USER INFORMATION

Name of tester:

Name of organization:

Location: (please include country)
(Enter a single period ".") on a line to indicate the end of the information.)

The next two pieces of information: email and phone number are for our internal use only. They will not be posted on the web or distributed. Email and phone number allow us to contact you if we have questions about your results.
Email Address:

Phone Number:

CLOSING

Your results have been tarred, gzipped and uuencoded.
To actually send your results at the command line please type:
 (if Linux system)
mail -s "Consolidated Results for Ballista OS Robustness Test Suite" ballista@ece.cmu.edu < consolidate.tar.gz.uu
(otherwise)
mail ballista@ece.cmu.edu< consolidate.tar.gz.uu
Thank you for reporting your results

Mail Results

After consolidating the results there is the optional step of submitting the results for inclusion in the Ballista Results Listing. Submitting your results is done by using the following mail commands from the .../ballista directory.

If you do not see your results posted after a week please send a follow up email to ballista@ece.cmu.edu.

View Results