Automated Robustness Testing of Off-the-Shelf Software Components

6/21/98


Click here to start


BACK TO ABSTRACT

Table of Contents

Automated Robustness Testing of Off-the-Shelf Software Components

The Big Picture: Ballista Project

Overview: Ballista Robustness Testing

System Robustness

Measuring Robustness

Ballista Automated Testing Goals

Ballista Software Testing Heritage

Ballista Fault Injection Heritage

Ballista: “High Level” + “Repeatable”

CRASH Severity Scale

A Challenge: Scalability

Scalable Test Generation -- Scaffolding

Ballista: Scalable Test Generation

Scalable Test Generation -- An Oracle

So, Did It Find Anything?

What We Measured

Was It Portable?

Was It Repeatable + Scalable?

Conclusions

Anybody can build a system that works when it works,

Author: Philip Koopman

Email: koopman@cmu.edu

Home Page: http://www.ices.cmu.edu/ballista