Halim, Felicia (2014) Evaluate and Benchmark Aris. Masters thesis, National University of Ireland Maynooth.
Preview
Felicia Halim - evaluate and benchmark Aris.pdf
Download (1MB) | Preview
Abstract
In this paper, we present evaluation and benchmark of Aris (Analogical Reasoning for reuse of
Implementation & Specification). Aris aims to increase the number of verified programs by
promotes the advantages of code reuse and the possibility of transferring specifications
between similar implementations. Source code retrieval in Aris acts as an enabling technology
for the reuse of formal specifications. Although the result of the early version of Aris is
encouraging and show potential reuse of formal specifications, it still has many rooms for
improvements and wide possibility for feature enhancement. By using experimental
methodology, we identify the issues and limitation of Aris 1.0. We develop Aris 2.0 that improve
the construction of conceptual graph, reduce the occurrences of false variable and loop
mapping, enable adjustment for transferring specifications between different iteration process
of for loop, and support assert and assume specifications transfer. We also introduce new
metric (specification score) to ensure that the top ranked retrieved documents possess good
quality specifications for transferring specifications. Finally, we compare the performance of Aris
1.0 and Aris 2.0 as retrieval and mapping system and also its ability to create the verified
specification. In order to evaluate and benchmark Aris, we use 2 million methods of unverified
implementations real world example amongst verified implementation. Our overall result shows
the improvement in Aris 2.0 able to produce more successful mapping between similar source
code files, increase ranking precision in retrieval phase, and generate more verified
specifications.
Item Type: | Thesis (Masters) |
---|---|
Additional Information: | Taught Masters Thesis for the Erasmus Mundus MSc in Dependable Software Systems |
Keywords: | Aris; |
Academic Unit: | Faculty of Science and Engineering > Computer Science |
Item ID: | 5341 |
Depositing User: | IR eTheses |
Date Deposited: | 03 Sep 2014 15:17 |
URI: | https://mural.maynoothuniversity.ie/id/eprint/5341 |
Use Licence: | This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here |
Repository Staff Only (login required)
Downloads
Downloads per month over past year