Workshop. Towards comparative evaluation in user modeling ,adaptation and personalization.
Views: 660
When : 2017-07-09
Where : Bratislava, Slovakia
Submission Deadline : 2017-04-20
Categories : Automation , Information Technology Management
Workshop. Towards comparative evaluation in user modeling ,adaptation and personalization.
(EvalUMAP 2017)
Jul 9, 2017,Bratislava, Slovakia
Call for Papers:
Research in the areas of User Modelling, Adaptation and Personalization faces a number of significant scientific challenges. One of the most significant of these challenges is the issue of comparative evaluation. It has always been difficult to rigorously compare different approaches to personalization, as the function of the resulting systems is, by their nature, heavily influenced by the behaviour of the users involved in trialling the systems. To-date this topic has received relatively little attention. Developing comparative evaluations in this space would be a huge advancement as it would enable shared comparison across research, which to-date has been very limited
Topics:
- Understanding UMAP evaluation
- Defining tasks and scenarios for evaluation purposes
- Identification of potential corpora (datasets) for shared tasks
- Automated and semi automated processes on creating appropriate datasets and simulating user behaviours etc in order to
- accommodate a shared task
- Interesting target tasks and explanations of their importance
- Critiques or comparisons of existing evaluation metrics and methods
- How we can combine existing evaluation metrics and methods?
- Reusing or improving previously suggested metrics and methods
- Reducing the cost of evaluation
- Proposal of new evaluation metrics and methods
- Technical challenges associated with design and implementation
- Anonymization of datasets, Privacy, Ethics and Security issues on the use of datasets
Important Dates:
- Workshop/Tutorial Proposal deadline:Apr 20, 2017
- Notification of Acceptance:May 20, 2017
- Final Version Due:May 28, 2017
User Name : Jackson
Posted 21-03-2017 on 15:20:03 AEDT