MURAL - Maynooth University Research Archive Library



    Evaluate and Benchmark Aris


    Halim, Felicia (2014) Evaluate and Benchmark Aris. Masters thesis, National University of Ireland Maynooth.

    [thumbnail of Felicia Halim - evaluate and benchmark Aris.pdf]
    Preview
    Text
    Felicia Halim - evaluate and benchmark Aris.pdf

    Download (1MB) | Preview

    Abstract

    In this paper, we present evaluation and benchmark of Aris (Analogical Reasoning for reuse of Implementation & Specification). Aris aims to increase the number of verified programs by promotes the advantages of code reuse and the possibility of transferring specifications between similar implementations. Source code retrieval in Aris acts as an enabling technology for the reuse of formal specifications. Although the result of the early version of Aris is encouraging and show potential reuse of formal specifications, it still has many rooms for improvements and wide possibility for feature enhancement. By using experimental methodology, we identify the issues and limitation of Aris 1.0. We develop Aris 2.0 that improve the construction of conceptual graph, reduce the occurrences of false variable and loop mapping, enable adjustment for transferring specifications between different iteration process of for loop, and support assert and assume specifications transfer. We also introduce new metric (specification score) to ensure that the top ranked retrieved documents possess good quality specifications for transferring specifications. Finally, we compare the performance of Aris 1.0 and Aris 2.0 as retrieval and mapping system and also its ability to create the verified specification. In order to evaluate and benchmark Aris, we use 2 million methods of unverified implementations real world example amongst verified implementation. Our overall result shows the improvement in Aris 2.0 able to produce more successful mapping between similar source code files, increase ranking precision in retrieval phase, and generate more verified specifications.
    Item Type: Thesis (Masters)
    Additional Information: Taught Masters Thesis for the Erasmus Mundus MSc in Dependable Software Systems
    Keywords: Aris;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Item ID: 5341
    Depositing User: IR eTheses
    Date Deposited: 03 Sep 2014 15:17
    URI: https://mural.maynoothuniversity.ie/id/eprint/5341
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads