MURAL - Maynooth University Research Archive Library

    Scholarly Influence of the Conference and Labs of the Evaluation Forum eHealth Initiative: Review and Bibliometric Study of the 2012 to 2017 Outcomes

    Suominen, Hanna and Kelly, Liadh and Goeuriot, Lorraine (2018) Scholarly Influence of the Conference and Labs of the Evaluation Forum eHealth Initiative: Review and Bibliometric Study of the 2012 to 2017 Outcomes. JMIR Research Protocols, 7 (e10961). ISSN 1929-0748

    Download (942kB) | Preview
    Official URL:

    Share your research

    Twitter Facebook LinkedIn GooglePlus Email more...

    Add this article to your Mendeley library


    The eHealth initiative of the Conference and Labs of the Evaluation Forum (CLEF) has aimed since 2012 to provide researchers working on health text analytics with annual workshops, shared development challenges and tasks, benchmark datasets, and software for processing and evaluation. In 2012, it ran as a scientific workshop with the aim of establishing an evaluation lab, and since 2013, this annual workshop has been supplemented with 3 or more preceding labs each year. An evaluation lab is an activity where the participating individuals or teams’ goal is to solve the same problem, typically using the same dataset in a given time frame. The overall purpose of this initiative is to support patients, their next of kin, clinical staff, health scientists, and health care policy makers in accessing, understanding, using, and authoring health information in a multilingual setting. In the CLEF eHealth 2013 to 2017 installations, the aim was to address patient-centric text processing. From 2015, the scope was also extended to aid both patients’ understanding and clinicians’ authoring of various types of medical content. CLEF eHealth 2017 introduced a new pilot task on technology-assisted reviews (TARs) in empirical medicine in order to support health scientists and health care policymakers’ information access.

    Item Type: Article
    Additional Information: ©Hanna Suominen, Liadh Kelly, Lorraine Goeuriot. Originally published in JMIR Research Protocols (, 27.07.2018. This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.
    Keywords: evaluation studies as topic; health records; information extraction; information storage and retrieval; information visualization; patient education as topic; speech recognition; systematic reviews; test-set generation; text classification;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Item ID: 10278
    Identification Number:
    Depositing User: Liadh Kelly
    Date Deposited: 04 Dec 2018 17:14
    Journal or Publication Title: JMIR Research Protocols
    Publisher: JMIR Publications
    Refereed: Yes

    Repository Staff Only(login required)

    View Item Item control page


    Downloads per month over past year