A Test Adequacy Infrastructure with Database Interaction Awareness

Tuesday, November 8, 2005 - 4:02pm

Gregory M. Kapfhammer
Department of Computer Science Allegheny College
Date: Monday November 7, 2005
Time: 3:00pm – 4:00pm
Location: Engineering I, Room 2114

Although a software application always executes within a particular environment, current testing methods have largely ignored these environmental factors. Since the database has become an important tool for managing a wide variety of information sources, many software applications execute in an environment that contains a database. This presentation describes a test adequacy infrastructure that includes (i) a model of database interaction faults, (ii) a unified application representation that expresses a program’s interaction with a relational database, and (iii) a family of test adequacy criteria that can be used to assess the quality of test suites for database-centric applications. Since a program often interacts with a database in a non-trivial fashion, the presented family of test adequacy criteria is designed to ensure that a test suite establishes a confidence in the correctness of a program’s interaction with a database. This presentation also analyzes results from the use of the test adequacy infrastructure during the empirical evaluation of a technique to calculate intraprocedural database interaction associations. The experiment results indicate that, for two database-centric case study applications, the presented adequacy criteria do require the coverage of database interactions that would not be tested by traditional data flow testing techniques that only focus on the definition and use of program variables. The experiments also reveal that the test requirements can be computed with an acceptable time and space overhead. The presented test adequacy infrastructure can be used as a central component within a comprehensive methodology for testing database-centric applications.

The research described in this presentation is joint with Mary Lou Soffa, Department of Computer Science, University of Virginia.

More information about the research described in this presentation is available at: http://cs.allegheny.edu/~gkapfham/research/diatoms/

Gregory M. Kapfhammer is a member of the faculty in the Department of Computer Science at Allegheny College and a PhD Candidate in the Department of Computer Science at the University of Pittsburgh. Kapfhammer has also held positions as a visiting research scientist in the Department of Computer Science at the University of Virginia and as a research associate at Cigital Research Labs. Kapfhammer’s research interests include software engineering, software testing and analysis, and distributed systems. The paper “A Family of Test Adequacy Criteria for Database-Driven Applications,” co-authored by Kapfhammer and Mary Lou Soffa, was selected to receive the ACM SIGSOFT Distinguished Paper Award at ESEC/FSE 2003.

Host: Chandra Krintz