MURAL - Maynooth University Research Archive Library



    The case for design science utility and quality - Evaluation of design science artifact within the sustainable ICT capability maturity framework


    Helfert, Markus and Donnellan, Brian and Ostrowski, Lukasz (2012) The case for design science utility and quality - Evaluation of design science artifact within the sustainable ICT capability maturity framework. Systems, Signs and Actions: An International Journal on Information Technology, Action, Communication and Workpractices, 6 (1). pp. 46-66. ISSN 1652-8719

    [img]
    Preview
    Download (282kB) | Preview


    Share your research

    Twitter Facebook LinkedIn GooglePlus Email more...



    Add this article to your Mendeley library


    Abstract

    In Design Science Research (DSR), evaluation of research outputs in form of design artifacts has been discussed in numerous publications. Many researchers have emphasised the criteria of utility for design artifacts, whereas recent approaches have extended this view to other criteria such as efficiency, consistency, accuracy, performance and reliability to mention a few. In this paper we revisit the evaluation discussion in design science and describe a practical oriented evaluation framework. In order to incorporate the evaluation along ongoing de-sign cycles, we propose to build on work related to semiotic and information quality. We ar-gue that design science research is usually complex and requires a more detailed evaluation approach. We review literature and follow a semiotic framework for managing knowledge in complex environments. Together with well established information quality criteria we demonstrate that the proposed framework can help to provide a practical evaluation approach within a complex design environment. The framework was developed within the context of a novel IT Management model. We describe its development during the creation of the maturity model for Sustainable Information and Communication Technology (ICT) called the SICT-Capability Maturity Framework (SICT-CMF). The context was selected as it is particular interesting with design artifacts created within an open and complex innovation community. The research acknowledges the importance of the utility criteria, but also includes other criteria such as artifact quality, consistency and accuracy in form of a more differentiated view of design science evaluation.

    Item Type: Article
    Additional Information: This paper is developed from the previous publication: Helfert M & Donnellan B (2012) The case for design science utility - Evaluation of design science artefacts within the IT capability maturity framework, accepted to the International Workshop on IT Artefact Design & Work Practice Intervention, Barcelona
    Keywords: Design Science; Utility; Evaluation; Quality; Information Quality; Semiotic;
    Academic Unit: Faculty of Social Sciences > Research Institutes > Innovation Value Institute, IVI
    Faculty of Social Sciences > School of Business
    Item ID: 10867
    Depositing User: Prof. Brian Donnellan
    Date Deposited: 12 Jun 2019 15:40
    Journal or Publication Title: Systems, Signs and Actions: An International Journal on Information Technology, Action, Communication and Workpractices
    Publisher: Linköping University
    Refereed: Yes
    URI:

    Repository Staff Only(login required)

    View Item Item control page

    Downloads

    Downloads per month over past year