RiVal - A toolkit to foster reproducibility in recommender system evaluation

Alan Said, A. Bellogín. 2014, "RiVal - A toolkit to foster reproducibility in recommender system evaluation". RecSys 2014 - Proceedings of the 8th ACM Conference on Recommender Systems.

Abstract

Currently, it is diffcult to put in context and compare the results from a given evaluation of a recommender system, mainly because too many alternatives exist when design- ing and implementing an evaluation strategy. Furthermore, the actual implementation of a recommendation algorithm sometimes diverges considerably from the well-known ideal formulation due to manual tuning and modifications observed to work better in some situations. RiVal - a recommender system evaluation toolkit - allows for complete control of the different evaluation dimensions that take place in any experimental evaluation of a recommender system: data split- ting, definition of evaluation strategies, and computation of evaluation metrics. In this demo we present some of the functionality of RiVal and show step-by-step how RiVal can be used to evaluate the results from any recommendation framework and make sure that the results are comparable and reproducible.

Publication
RecSys 2014 - Proceedings of the 8th ACM Conference on Recommender Systems