Hennessey, Mark and Power, James F. (2008) Analysing the effectiveness of rule-coverage as a reduction criterion for test suites of grammar-based software. Empirical Software Engineering, 13 (4). pp. 343-368. ISSN 1382-3256

Preview

Download (599kB) | Preview

Abstract

The term grammar-based software describes software whose input can be specified by a context-free grammar. This grammar may occur explicitly in the software, in the form of an input specification to a parser generator, or implicitly, in the form of a hand-written parser. Grammar-based software includes not only programming language compilers, but also tools for program analysis, reverse en- gineering, software metrics and documentation generation. Hence, ensuring their completeness and correctness is a vital prerequisite for their use. In this paper we propose a strategy for the construction of test suites for grammar based software, and illustrate this strategy using the ISO C++ grammar. We use the concept of grammar- rule coverage as a pivot for the reduction of an implementation-based test suite, and demonstrate a significant decrease in the size of this suite. The effectiveness of this reduced test suite is compared to the original test suite with respect to code coverage and more importantly, fault detection. This work greatly expands upon previous work in this area and utilises large scale mutation testing to compare the effectiveness of grammar-rule coverage to that of statement coverage as a reduction criterion for test suites of grammar-based software. This work finds that when grammar rule coverage is used as the sole criterion for reducing test suites of grammar based software, the fault detection capability of that reduced test suite is greatly diminished when compared to other coverage criteria such as statement coverage

Item Type:	Article
Keywords:	Software testing; Grammar-based software; Test suite reduction; Rule coverage; Mutation testing;
Academic Unit:	Faculty of Science and Engineering > Computer Science
Item ID:	8225
Identification Number:	https://doi.org/10.1007/s10664-008-9067-7
Depositing User:	Dr. James Power
Date Deposited:	17 May 2017 15:35
Journal or Publication Title:	Empirical Software Engineering
Publisher:	http://link.springer.com
Refereed:	Yes
URI:	http://link.springer.com
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads