Table of Contents
Automated Robustness Testing of
Off-the-Shelf Software Components
The Big Picture: Ballista Project
Overview: Ballista Robustness
Testing
System Robustness
Measuring Robustness
Ballista Automated Testing Goals
Ballista Software Testing
Heritage
Ballista Fault Injection Heritage
Ballista: “High Level”
+ “Repeatable”
CRASH Severity Scale
A Challenge: Scalability
Scalable Test Generation --
Scaffolding
Ballista: Scalable Test
Generation
Scalable Test Generation -- An
Oracle
So, Did It Find Anything?
What We Measured
Was It Portable?
Was It Repeatable + Scalable?
Conclusions
Anybody can build a system that
works when it works, |
Author: Philip Koopman
Email: koopman@cmu.edu
Home Page:
http://www.ices.cmu.edu/ballista
|