Huisman, Marieke and Klebanov, Vladimir and Monahan, Rosemary (2012) On the Organisation of Program Verification Competitions. Proceedings of the 1st International Workshop on Comparative Empirical Evaluation of Reasoning Systems, 873. pp. 50-59. ISSN 1613-0073

Download (173kB)

Abstract

In this paper, we discuss the challenges that have to be addressed when organising program verification competitions. Our focus is on competitions for verification systems where the participants both formalise an informally stated requirement and (typically) provide some guidance for the tool to show it. The paper draws its insights from our experiences with organising a program verification competition at FoVeOOS 2011. We discuss in particular the following aspects: challenge selection, on-site versus online organisation, team composition and judging. We conclude with a list of recommendations for future competition organisers.

Item Type:	Article
Keywords:	Program Verification Competitions;
Academic Unit:	Faculty of Science and Engineering > Computer Science
Item ID:	3893
Depositing User:	Rosemary Monahan
Date Deposited:	24 Sep 2012 15:39
Journal or Publication Title:	Proceedings of the 1st International Workshop on Comparative Empirical Evaluation of Reasoning Systems
Publisher:	CEUR
Refereed:	Yes
URI:	Publisher
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads