Halim, Felicia (2014) Evaluate and Benchmark Aris. Masters thesis, National University of Ireland Maynooth.

Preview

Download (1MB) | Preview

Abstract

In this paper, we present evaluation and benchmark of Aris (Analogical Reasoning for reuse of Implementation & Specification). Aris aims to increase the number of verified programs by promotes the advantages of code reuse and the possibility of transferring specifications between similar implementations. Source code retrieval in Aris acts as an enabling technology for the reuse of formal specifications. Although the result of the early version of Aris is encouraging and show potential reuse of formal specifications, it still has many rooms for improvements and wide possibility for feature enhancement. By using experimental methodology, we identify the issues and limitation of Aris 1.0. We develop Aris 2.0 that improve the construction of conceptual graph, reduce the occurrences of false variable and loop mapping, enable adjustment for transferring specifications between different iteration process of for loop, and support assert and assume specifications transfer. We also introduce new metric (specification score) to ensure that the top ranked retrieved documents possess good quality specifications for transferring specifications. Finally, we compare the performance of Aris 1.0 and Aris 2.0 as retrieval and mapping system and also its ability to create the verified specification. In order to evaluate and benchmark Aris, we use 2 million methods of unverified implementations real world example amongst verified implementation. Our overall result shows the improvement in Aris 2.0 able to produce more successful mapping between similar source code files, increase ranking precision in retrieval phase, and generate more verified specifications.

Item Type:	Thesis (Masters)
Additional Information:	Taught Masters Thesis for the Erasmus Mundus MSc in Dependable Software Systems
Keywords:	Aris;
Academic Unit:	Faculty of Science and Engineering > Computer Science
Item ID:	5341
Depositing User:	IR eTheses
Date Deposited:	03 Sep 2014 15:17
URI:
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads