Table of Contents
Software Robustness Evaluation http://www.ices.cmu.edu/ballista
The Big Picture: Ballista Project
Overview: Ballista Automated Robustness Testing
System Robustness
Ariane 5 Flight 501 Robustness Failure _
System Robustness -- Improves Dependability
Ballista Software Testing Heritage
Ballista Fault Injection Heritage
Ballista: Scalable Test Generation
Ballista: “High Level” + “Repeatable”
OS Robustness Testing
CRASH Severity Scale
233 Functions/Calls For One OS
Comparing Fifteen Operating Systems
C Library Is A Potential Robustness Bottleneck
Data Analysis Using N-Version Voting
Voted Results (Estimated Failure Rates)
Common Failure Sources
Issues & Future Directions
Is Dumping Core The “Right Thing?”
Next Step: Robustness Testing Service
Ballista Capability Summary
Conclusions
http://www.ices.cmu.edu/ballista
Failure Rates By POSIX Fn/Call Category
C Library Robustness Failures
|
Author: Philip Koopman
Email: koopman@cmu.edu
Home Page: http://www.ices.cmu.edu/ballista
|