Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MovieLens performance #19

Open
bkj opened this issue Jun 13, 2018 · 3 comments
Open

MovieLens performance #19

bkj opened this issue Jun 13, 2018 · 3 comments

Comments

@bkj
Copy link

bkj commented Jun 13, 2018

Hi All --

Has anyone ever benchmarks this package on the MovieLens datasets? I'm looking at this for the first time and trying to figure out what hyperparamers need to be tuned to get good performance.

Thanks!
~ Ben

EDIT: Related -- if anyone has a pointer to a properly parameterized example of using this library, that'd also be super helpful.

@albietz
Copy link
Contributor

albietz commented Jun 15, 2018

Hi,

I'm not sure anyone has tried QMF on MovieLens, but iirc MovieLens consists of data with explicit feedback (i.e. ratings, while QMF deals with implicit data, like "clicks")?
Either way, if you do try it out, let us know how it does!

Alberto

@bkj
Copy link
Author

bkj commented Jun 15, 2018

I think it's fine to binarize MovieLens and treat it as implicit feedback -- the number of movies reviewed per user is pretty small. Then you try to optimize eg. the p@k over some held out data split.

~ Ben

@albietz
Copy link
Contributor

albietz commented Jun 15, 2018

Fair -- feel free to post your findings here if you try that out.

Alberto

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants