Was It Repeatable + Scalable?

• http://www.ices.cmu.edu/ballista -- Digital Unix demo

  • Generates single-test “bug report” programs
  • Reproduces results by executing a program from the command line

• Yes, it’s scalable

  • Generates ~100,000 test cases for 233 functions
  • ~2000 lines of “easy” C code to test 20 data types
    • (plus Ballista test harness)
  • A reasonable amount of system state is tested without per-test scaffolding
    • e.g., files, memory arrays, data structures
    • The encapsulation of system state within test cases really worked
  • Work on a simulation backplane API for looks promising

Previous slide

Next slide

Back to first slide

View graphic version