A Survey of Transfer Learning for Collaborative Recommendation with Auxiliary Data Weike Pan College of Computer Science and Software Engineering Shenzhen University [email protected] Part of this work was done when Weike Pan was a Ph.D. student under the supervision of Prof. Qiang Yang in the Department of Computer Science and Engineering, Hong Kong University of Science and Technology.

Outline • Introduction – Collaborative Recommendation – Auxiliary Data – A Transfer Learning View

• • • • • •

Collaborative Recommendation with Auxiliary Data Adaptive Knowledge Transfer Collective Knowledge Transfer Integrative Knowledge Transfer Discussions and Future Directions Acknowledgement

2

Introduction

Collaborative Recommendation • A standard component in most Internet systems – E-commerce systems – Advertisement systems

• Limitation – Limited to users' feedbacks of explicit scores or implicit examinations

• Challenge – Sparsity, i.e., lack of users’ feedbacks

3

Introduction

Auxiliary Data • Additional data: have the potential to help reduce the sparsity effect

4

Introduction

A Transfer Learning View • Target data: users' feedbacks • Auxiliary data: other additional information

• Focus: how to achieve knowledge transfer from some auxiliary data to a target data, i.e., “how to transfer” in transfer learning [Pan and Yang, TKDE 2010]

5

Outline • Introduction • Collaborative Recommendation with Auxiliary Data – Problem Definition – Categorization of Knowledge Transfer – A Generic Knowledge Transfer Framework

• • • • •

Adaptive Knowledge Transfer Collective Knowledge Transfer Integrative Knowledge Transfer Discussions and Future Directions Acknowledgement

6

Collaborative Recommendation with Auxiliary Data

Problem Definition • Target data: a rating matrix • Auxiliary data: , e.g., content, context, network and feedback • Goal: predict the unobserved rating in by transferring knowledge from

Transfer Learning for Collaborative Recommendation with Auxiliary Data (TL-CRAD)

7

Collaborative Recommendation with Auxiliary Data

Categorization of Knowledge Transfer • Knowledge transfer algorithm styles – Adaptive knowledge transfer – Collective knowledge transfer – Integrative knowledge transfer

• Knowledge transfer strategies – Transfer via prediction rule – Transfer via regularization – Transfer via constraint

8

Collaborative Recommendation with Auxiliary Data

A Generic Knowledge Transfer Framework • A generic framework for TL-CRAD

– – – – – – –

: a loss function , : two regularization terms : a constraint : target user-item rating matrix : auxiliary data : extracted knowledge from auxiliary data : model parameters

9

Outline • Introduction • Collaborative Recommendation with Auxiliary Data • Adaptive Knowledge Transfer – Transfer via Regularization – Transfer via Constraint

• • • •

Collective Knowledge Transfer Integrative Knowledge Transfer Discussions and Future Directions Acknowledgement

10

Adaptive Knowledge Transfer

Adaptive Knowledge Transfer • Adaptive knowledge transfer aims to adapt the knowledge extracted from an auxiliary data domain to a target data domain. This is a directed knowledge transfer approach similar to traditional domain adaptation methods.

11

Adaptive Knowledge Transfer

Transfer via Regularization • Instantiation from the generic framework

Example • Coordinate System Transfer (CST) [Pan, Xiang, Liu and Yang, AAAI 2010]

– The two biased regularization terms are used to constrain the latent feature matrices of target data to be similar to that of auxiliary data. – Biased regularization is a popular technique in domain adaptation.

12

Adaptive Knowledge Transfer

Transfer via Constraint • Instantiation from the generic framework

Example • Codebook Transfer (CBT) [Li, Yang and Xue, IJCAI 2009]

– The constraint on two codebooks is used to constrain cluster-level rating pattern of target data to be the same with that of auxiliary data. – Cluster-level rating pattern is a kind of group behavior with higher transferability.

13

Outline • • • •

Introduction Collaborative Recommendation with Auxiliary Data Adaptive Knowledge Transfer Collective Knowledge Transfer – Transfer via Constraint

• Integrative Knowledge Transfer • Discussions and Future Directions • Acknowledgement

14

Collective Knowledge Transfer

Collective Knowledge Transfer • Collective knowledge transfer usually jointly learns the shared knowledge and unshared effect of the target data and the auxiliary data simultaneously. This is a bi-directed knowledge transfer approach with richer interactions similar to multi-task learning algorithms.

15

Collective Knowledge Transfer

Transfer via Constraint • Instantiation from the generic framework

Example • Collective Matrix Factorization (CMF) [Singh and Gordon, KDD 2008]

– The constraint on two latent feature matrices is used to enable knowledge transfer between the target data and the auxiliary data. – The assumption that same entities (e.g., users and/or items) from the target data and the auxiliary data are associated with the same latent factors is quite universal.

16

Outline • • • • •

Introduction Collaborative Recommendation with Auxiliary Data Adaptive Knowledge Transfer Collective Knowledge Transfer Integrative Knowledge Transfer – Transfer via Prediction Rule – Transfer via Regularization – Transfer via Constraint

• Discussions and Future Directions • Acknowledgement

17

Integrative Knowledge Transfer

Integrative Knowledge Transfer • Integrative knowledge transfer incorporates the raw auxiliary data as known knowledge into the learning task on the target data. It can be considered as an embedded knowledge transfer approach similar to feature engineering, information fusion and data integration methods.

18

Integrative Knowledge Transfer

Transfer via Prediction Rule • Instantiation from the generic framework

Example • Recommendation with Social Trust Ensemble (RSTE) [Ma, King and Lyu, TIST 2011]

– The expanded prediction rule is used to transfer social tastes from the auxiliary data to the target data. – Integrating the auxiliary data via a revised prediction rule is a natural and effective knowledge transfer approach, though it may cause high time complexity.

19

Integrative Knowledge Transfer

Transfer via Regularization • Instantiation from the generic framework

Example • Tag Informed Collaborative Filtering (TagiCoFi) [Zhen, Li and Yeung, RecSys 2009]

– The manifold regularization term is used to constrain similar users in the auxiliary data to be similar in the latent space of the target data. – Manifold regularization term and its variants are a popular technique in semi-supervised machine learning.

20

Integrative Knowledge Transfer

Transfer via Constraint • Instantiation from the generic framework

Example • Transfer by Integrative Factorization (TIF) [Pan, Xiang and Yang, AAAI 2012]

– The constraint requires that the estimated preference by the learned model of the target data is in the range of the corresponding uncertain rating of the auxiliary data. – Incorporating auxiliary data via constraints is quite flexible since auxiliary data can often be represented as some constraints.

21

Outline • • • • • •

Introduction Collaborative Recommendation with Auxiliary Data Adaptive Knowledge Transfer Collective Knowledge Transfer Integrative Knowledge Transfer Discussions and Future Directions – Discussions – Future Directions – Conclusions

• Acknowledgement

22

Discussions and Future Directions

Discussions (1/2) • TL-CRAD

– The interaction between auxiliary data and target data becomes richer from adaptive, collective, to integrative algorithm styles, which are believed to enable more effective knowledge transfer. – The time complexity may also increase from adaptive, collective, to integrative algorithm styles. 23

Discussions and Future Directions

Discussions (2/2) • A generic framework

• Summary

– Collective knowledge transfer via constraint and integrative knowledge transfer via prediction rule have recently received more attention. 24

Discussions and Future Directions

Future Directions • Heterogeneous Techniques Ensemble – Design some heterogeneous knowledge transfer algorithm styles and strategies in order to achieve a good balance among flexibility, effectiveness and efficiency.

• Heterogeneous Data Integration – Develop a unified framework for heterogeneous auxiliary data in a scalable and distributed way.

• Multi-Objective Recommendation – Design a sophisticated objective function with different evaluation metrics (e.g., accuracy, diversity, serendipity, quality of service) when exploiting the auxiliary data.

• Explanation and Security – Take auxiliary data as a source for explanation generation of the recommended items, and even for robustness against malicious attack or fake actions.

25

Discussions and Future Directions

Conclusions • Intelligent recommendation approaches (with one more category) – Content-based Recommendation (CBR): promote an item based on the relevance between a candidate item and the active user's consumed items. – Collaborative Recommendation (CR): recommend preferred items from similar-taste users.

– Transfer Learning for Collaborative Recommendation with Auxiliary Data (TL-CRAD): learn users’ preference via transferring knowledge from some auxiliary data (e.g., content, context, network and feedback) to a target data of users’ feedbacks.

26

Outline • • • • • • •

Introduction Collaborative Recommendation with Auxiliary Data Adaptive Knowledge Transfer Collective Knowledge Transfer Integrative Knowledge Transfer Discussions and Future Directions Acknowledgement

27

Acknowledgement

Thank You! • Thanks for your attention! • Thank Prof. Qiang Yang for advice and comments! • Thank anonymous editors and reviewers for constructive suggestions!

• Thank the support of Natural Science Foundation of Guangdong Province, National Natural Science Foundation of China, and Natural Science Foundation of SZU!

28

CoFiSet: Collaborative Filtering via Learning Pairwise ...

from an auxiliary data domain to a target data domain. This is a directed knowledge transfer approach similar to traditional domain adaptation methods. Adaptive ...

1MB Sizes 4 Downloads 289 Views

Recommend Documents

Collaborative Filtering via Learning Pairwise ... - Semantic Scholar
assumption can give us more accurate pairwise preference ... or transferring knowledge from auxiliary data [10, 15]. However, in real ..... the most popular three items (or trustees in the social network) in the recommended list [18], in order to.

Transfer Learning for Collaborative Filtering via a ...
aims at predicting an active user's ratings on a set of. Appearing in Proceedings of ...... J. of Artificial Intelligence Research, 12, 149–198. Caruana, R. A. (1997).

Transfer learning in heterogeneous collaborative filtering domains
E-mail addresses: [email protected] (W. Pan), [email protected] (Q. Yang). ...... [16] Michael Collins, S. Dasgupta, Robert E. Schapire, A generalization of ... [30] Daniel D. Lee, H. Sebastian Seung, Algorithms for non-negative matrix ...

Transfer Learning in Collaborative Filtering for Sparsity Reduction
ematically, we call such data sparse, where the useful in- ... Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI-10) ... way. We observe that these two challenges are related to each other, and are similar to the ...

Collaborative Filtering Personalized Skylines..pdf
There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this item. Collaborative ...

Combinational Collaborative Filtering for ... - Research at Google
Aug 27, 2008 - Before modeling CCF, we first model community-user co- occurrences (C-U) ...... [1] Alexa internet. http://www.alexa.com/. [2] D. M. Blei and M. I. ...

Content-Boosted Collaborative Filtering
Most recommender systems use Collaborative Filtering or ... file. Because of these reasons, CF systems have been used ..... -means clustering algorithm.

Collaborative Filtering with Personalized Skylines
A second alternative incorporates some content-based (resp. CF) characteristics into a CF (resp. content-based) system. Regarding concrete systems, Grundy proposes stereo- types as a mechanism for modeling similarity in book rec- ommendations [36]. T

Securing Collaborative Filtering Against Malicious ...
the IEEE Joint Conference on E-Commerce Technol- ogy and Enterprise Computing, E-Commerce and E-. Services (CEC/EEE 2006). Burke, R.; Mobasher, B.; and Bhaumik, R. 2005. Lim- ited knowledge shilling attacks in collaborative filter- ing systems. In Pr

Attack Resistant Collaborative Filtering - Research at Google
topic in Computer Science with several successful algorithms and improvements over past years. While early algorithms exploited similarity in small groups ...

Using Mixture Models for Collaborative Filtering - Cornell Computer ...
Using Mixture Models for Collaborative Filtering. Jon Kleinberg. ∗. Department of Computer Science. Cornell University, Ithaca, NY, 14853 [email protected].

An Incremental Approach for Collaborative Filtering in ...
Department of Computer Science and Engineering, National Institute of Technology. Rourkela, Rourkela, Odisha ... real-world datasets show that the proposed approach outperforms the state-of-the-art techniques in ... 1 Introduction. Collaborative filt

Practical privacy preserving collaborative filtering on ...
A recommendation example: Amazon's “people who buy x also buy y”. Recommendation .... Amazon Web Services Elastic Beanstalk (AWS EBS)2. PaaS cloud.

Feasibility of a privacy preserving collaborative filtering ... - Anirban Basu
cloud for running web applications developed in Python,. 3Report available at .... Extensions in the GAE/J, the open-source University of. Texas (Dallas) Paillier ...

Adaptive Pairwise Preference Learning for ...
Nov 7, 2014 - vertisement, etc. Automatically mining and learning user- .... randomly sampled triple (u, i, j), which answers the question of how to .... triples as test data. For training data, we keep all triples and take the corresponding (user, m

Practical privacy preserving collaborative filtering on the Google App ...
Google App Engineにおけるプライバシー保護協調フィルタリング ... 方式を Platform-as-a-Service (PaaS) cloud によって実現されている Software-as-a-Service (SaaS).

Collaborative Filtering Supporting Web Site Navigation
rithms that try to cluster users with respect some (given ... tion Systems, with the emerging filtering technologies .... file, the user is interested in the document.

Privacy-preserving collaborative filtering on the cloud ...
which implements a small subset of SQL. ... used the Amazon Relational Database Service (RDS), where a ... The performance also degrades if the database.

Privacy-preserving collaborative filtering for the cloud
Your private rating data may not be safe on the cloud because of insider and outsider threats. Anirban Basu, et al. Cloud based privacy preserving CF. 4/22 ...

Collaborative Filtering as a Multi-Armed Bandit - HAL-Inria
Jan 14, 2016 - values in R, and (ii) a strategy to choose the item to recommend given ..... [25] X. Luo, Y. Xia, and Q. Zhu, “Incremental Collaborative Filtering ...

Personalized Click Model through Collaborative Filtering - Botao Hu
lected, they offer a promising approach to optimize search engine performance with low cost. However, a well-known challenge of using such data is the position ...

Efficient privacy-preserving collaborative filtering based ...
Recently, more web-based services offered through cloud computing have only exacerbated the problem. User-tailored ...... Springer-Verlag, August 2000.