MURAL - Maynooth University Research Archive Library



    Analysing the effectiveness of rule-coverage as a reduction criterion for test suites of grammar-based software


    Hennessey, Mark and Power, James F. (2008) Analysing the effectiveness of rule-coverage as a reduction criterion for test suites of grammar-based software. Empirical Software Engineering, 13 (4). pp. 343-368. ISSN 1382-3256

    [thumbnail of JP-Analysing-2008.pdf]
    Preview
    Text
    JP-Analysing-2008.pdf

    Download (599kB) | Preview

    Abstract

    The term grammar-based software describes software whose input can be specified by a context-free grammar. This grammar may occur explicitly in the software, in the form of an input specification to a parser generator, or implicitly, in the form of a hand-written parser. Grammar-based software includes not only programming language compilers, but also tools for program analysis, reverse en- gineering, software metrics and documentation generation. Hence, ensuring their completeness and correctness is a vital prerequisite for their use. In this paper we propose a strategy for the construction of test suites for grammar based software, and illustrate this strategy using the ISO C++ grammar. We use the concept of grammar- rule coverage as a pivot for the reduction of an implementation-based test suite, and demonstrate a significant decrease in the size of this suite. The effectiveness of this reduced test suite is compared to the original test suite with respect to code coverage and more importantly, fault detection. This work greatly expands upon previous work in this area and utilises large scale mutation testing to compare the effectiveness of grammar-rule coverage to that of statement coverage as a reduction criterion for test suites of grammar-based software. This work finds that when grammar rule coverage is used as the sole criterion for reducing test suites of grammar based software, the fault detection capability of that reduced test suite is greatly diminished when compared to other coverage criteria such as statement coverage
    Item Type: Article
    Keywords: Software testing; Grammar-based software; Test suite reduction; Rule coverage; Mutation testing;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Item ID: 8225
    Identification Number: 10.1007/s10664-008-9067-7
    Depositing User: Dr. James Power
    Date Deposited: 17 May 2017 15:35
    Journal or Publication Title: Empirical Software Engineering
    Publisher: http://link.springer.com
    Refereed: Yes
    Related URLs:
    URI: https://mural.maynoothuniversity.ie/id/eprint/8225
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads