The validation of a recommender system is always a quite hazardous task, because of the difficulty of modeling the tastes of a given user. Novel (decentralized) recommender systems are proposed and evaluated by way of well known logs of user profiles and buddy tables, that contain lists of items with feedback ratings assigned by a given set of users. These information are cross linked, and the precision of the recommendation is compared with other well known (centralized) systems. This evaluation approach cannot be applied in the actual peer-to-peer domain: it is difficult, if not impossible, to build and maintain user profiles, and users are not required to give feedbacks to a data collector entity. Moreover, objects are poorly or not structured, and meta-information, when present, cannot be trusted because of fake files and incomplete item descriptions. In this paper, we present an evaluation process based on a 10-fold cross validation task, that we applied to estimate accuracy of the suggestions of a P2P recommender system recently proposed in [2]. The complexity of the evaluation of this peculiar recommender is increased because of "spontaneous affinities" between users that are used instead of classical knowledge representation based strategies.

Evaluating Peer-to-Peer Recommender Systems that Exploit Spontaneous Affinities

RUFFO, Giancarlo Francesco;SCHIFANELLA, ROSSANO
2007-01-01

Abstract

The validation of a recommender system is always a quite hazardous task, because of the difficulty of modeling the tastes of a given user. Novel (decentralized) recommender systems are proposed and evaluated by way of well known logs of user profiles and buddy tables, that contain lists of items with feedback ratings assigned by a given set of users. These information are cross linked, and the precision of the recommendation is compared with other well known (centralized) systems. This evaluation approach cannot be applied in the actual peer-to-peer domain: it is difficult, if not impossible, to build and maintain user profiles, and users are not required to give feedbacks to a data collector entity. Moreover, objects are poorly or not structured, and meta-information, when present, cannot be trusted because of fake files and incomplete item descriptions. In this paper, we present an evaluation process based on a 10-fold cross validation task, that we applied to estimate accuracy of the suggestions of a P2P recommender system recently proposed in [2]. The complexity of the evaluation of this peculiar recommender is increased because of "spontaneous affinities" between users that are used instead of classical knowledge representation based strategies.
2007
ACM symposium on Applied computing - SESSION: Trust, recommendations, evidence and other collaboration know-how (TRECK'07)
Seoul, Korea
11-15 March 2007
Proceedings of the 2007 ACM symposium on Applied computing
ACM
1574
1578
9781595934802
http://www.acm.org/conferences/sac/sac2007/
Peer-to-Peer; Recommender System; Complex and Social Networks; File Sharing Systems
G. RUFFO; R. SCHIFANELLA
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/27308
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 3
social impact