Helfert, Markus and Donnellan, Brian and Ostrowski, Lukasz (2012) The case for design science utility and quality - Evaluation of design science artifact within the sustainable ICT capability maturity framework. Systems, Signs and Actions: An International Journal on Information Technology, Action, Communication and Workpractices, 6 (1). pp. 46-66. ISSN 1652-8719

Preview

Download (282kB) | Preview

Abstract

In Design Science Research (DSR), evaluation of research outputs in form of design artifacts has been discussed in numerous publications. Many researchers have emphasised the criteria of utility for design artifacts, whereas recent approaches have extended this view to other criteria such as efficiency, consistency, accuracy, performance and reliability to mention a few. In this paper we revisit the evaluation discussion in design science and describe a practical oriented evaluation framework. In order to incorporate the evaluation along ongoing de-sign cycles, we propose to build on work related to semiotic and information quality. We ar-gue that design science research is usually complex and requires a more detailed evaluation approach. We review literature and follow a semiotic framework for managing knowledge in complex environments. Together with well established information quality criteria we demonstrate that the proposed framework can help to provide a practical evaluation approach within a complex design environment. The framework was developed within the context of a novel IT Management model. We describe its development during the creation of the maturity model for Sustainable Information and Communication Technology (ICT) called the SICT-Capability Maturity Framework (SICT-CMF). The context was selected as it is particular interesting with design artifacts created within an open and complex innovation community. The research acknowledges the importance of the utility criteria, but also includes other criteria such as artifact quality, consistency and accuracy in form of a more differentiated view of design science evaluation.

Item Type:	Article
Additional Information:	This paper is developed from the previous publication: Helfert M & Donnellan B (2012) The case for design science utility - Evaluation of design science artefacts within the IT capability maturity framework, accepted to the International Workshop on IT Artefact Design & Work Practice Intervention, Barcelona
Keywords:	Design Science; Utility; Evaluation; Quality; Information Quality; Semiotic;
Academic Unit:	Faculty of Social Sciences > Research Institutes > Innovation Value Institute, IVI Faculty of Social Sciences > School of Business
Item ID:	10867
Depositing User:	Prof. Brian Donnellan
Date Deposited:	12 Jun 2019 15:40
Journal or Publication Title:	Systems, Signs and Actions: An International Journal on Information Technology, Action, Communication and Workpractices
Publisher:	Linköping University
Refereed:	Yes
URI:	http://www.sysiac.org
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads