MURAL - Maynooth University Research Archive Library



    Overview of the CLEF eHealth Evaluation Lab 2018


    Suominen, Hanna and Kelly, Liadh and Goeuriot, Lorraine and Neveol, Aurelie and Ramadier, Lionel and Robert, Aude and Kanoulas, Evangelos and Spijker, Rene and Azzopardi, Leif and Li, Dan and Jimmy and Palotti, Joao and Zuccon, Guido (2018) Overview of the CLEF eHealth Evaluation Lab 2018. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction. Part of the Lecture Notes in Computer Science book series (LNCS) (11018). Springer, pp. 286-301. ISBN 9783319658131

    [img]
    Preview
    Download (326kB) | Preview


    Share your research

    Twitter Facebook LinkedIn GooglePlus Email more...



    Add this article to your Mendeley library


    Abstract

    In this paper, we provide an overview of the sixth annual edition of the CLEF eHealth evaluation lab. CLEF eHealth 2018 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French and English corpora to French, Hungarian, and Italian; Task 2 on technologically assisted reviews in empirical medicine building on last year’s pilot task in English; and Task 3 on Consumer Health Search (CHS) in mono- and multilingual settings that builds on the 2013–17 Information Retrieval tasks. In total 28 teams took part in these tasks (14 in Task 1, 7 in Task 2 and 7 in Task 3). Herein, we describe the resources created for these tasks, outline our evaluation methodology adopted and provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

    Item Type: Book Section
    Additional Information: Cite as: Suominen H. et al. (2018) Overview of the CLEF eHealth Evaluation Lab 2018. In: Bellot P. et al. (eds) Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2018. Lecture Notes in Computer Science, vol 11018. Springer, Cham. https://doi-org.jproxy.nuim.ie/10.1007/978-3-319-98932-7_26
    Keywords: Evaluation; Entity linking; Information retrieval Health records; Information extraction; Medical informatics; Systematic reviews; Total recall; Test-set generation; Text classification; Text segmentation; Self-diagnosis;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Faculty of Science and Engineering > Research Institutes > Hamilton Institute
    Faculty of Science and Engineering > Research Institutes > Human Health Institute
    Item ID: 13394
    Identification Number: https://doi.org/10.1007/978-3-319-98932-7_26
    Depositing User: Liadh Kelly
    Date Deposited: 05 Oct 2020 14:45
    Publisher: Springer
    Refereed: Yes
    URI:

    Repository Staff Only(login required)

    View Item Item control page

    Downloads

    Downloads per month over past year