Test suite reduction and prioritization with call trees

Smith, Adam M. and Geiger, Joshua J. and Kapfhammer, Gregory M. and Soffa, Mary Lou

Proceedings of the 22nd International Conference on Automated Software Engineering, 2007

Abstract

This paper presents a tool that (i) constructs tree-based models of a program’s behavior during testing and (ii) employs these trees while reordering and reducing a test suite. Using either a dynamic call tree or a calling context tree, the test reduction component identifies a subset of the original tests that covers the same call tree paths. The prioritization technique reorders a test suite so that it covers the call tree paths more rapidly than the initial test ordering. In support of program and test suite understanding, the tool also visualizes the call trees and the coverage relationships. For a chosen case study application, the experimental results show that call tree construction only increases testing time by 13%. In comparison to the original test suite, the experiments show that (i) a prioritized suite achieves coverage much faster and (ii) a reduced test suite contains 45% fewer tests and consumes 82% less time.

Resources

Paper

Presentation

Reference

@inproceedings{Smith2007b,
  author = {Smith, Adam M. and Geiger, Joshua J. and Kapfhammer, Gregory M. and Soffa, Mary Lou},
  title = {Test suite reduction and prioritization with call trees},
  booktitle = {Proceedings of the 22nd International Conference on Automated Software Engineering},
  year = {2007},
  presented = {true}
}
Return to the List of Papers
Like my work? Support it!