Conlan, Owen and Fraser, Kieran and Kelly, Liadh (2019) A User Modeling Shared Challenge Proposal. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2019. Lecture Notes in Computer Science book series (LNCS) (11696). Springer, pp. 171-177. ISBN 9783030285777

Preview

Download (257kB) | Preview

Abstract

Comparative evaluation in the areas of User Modeling, Adaptation and Personalization (UMAP) is significantly challenging. It has always been difficult to rigorously compare different approaches to personalization, as the function of the resulting systems is, by their nature, heavily influenced by the behavior of the users involved in trialing the systems. Developing comparative evaluations in this space would be a huge advancement as it would enable shared comparison across research. Here we present a proposal for a shared challenge generation in UMAP, focusing on user model generation using logged mobile phone data, with an assumed purpose of supporting mobile phone notification suggestion. The dataset, evaluation metrics, and challenge operation are described.

Item Type:	Book Section
Additional Information:	Cite as: Conlan O., Fraser K., Kelly L., Yousuf B. (2019) A User Modeling Shared Challenge Proposal. In: Crestani F. et al. (eds) Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2019. Lecture Notes in Computer Science, vol 11696. Springer, Cham. https://doi.org/10.1007/978-3-030-28577-7_13
Keywords:	Personalization; Evaluation; Shared task;
Academic Unit:	Faculty of Science and Engineering > Computer Science Faculty of Science and Engineering > Research Institutes > Human Health Institute
Item ID:	14367
Depositing User:	Liadh Kelly
Date Deposited:	22 Apr 2021 14:21
Publisher:	Springer
Refereed:	Yes
URI:	Publisher
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads