Comments on: Collaborative filtering and my younger self

By: Ariel Procaccia

Ariel Procaccia — Wed, 19 Dec 2012 19:49:02 +0000

Good point, but your first paragraph probably does not explain the Prometheus prediction, as it now has 241k+ ratings (with an average of 3.5) and it presumably had almost as many when I watched it recently.

By: memetics

memetics — Wed, 19 Dec 2012 11:54:51 +0000

Netflix appears to default to a rating of 3 stars for an unrated (or too-small-sample-size) movie or show. So it’s best to think of a 3 as “not yet rated by the Netflix community.”

Also, I rate Netflix based on whether I want Netflix to show me more of the same kind of movie/show or fewer – not on my real objective assessment of the show’s quality. Since offering me recommendations is really the main use to which they put my ratings, that’s the spirit by which I rate things. So for example, even if I see a fairly poor anime on Netflix, I might rate it high so they will keep showing me anime.

By: Yair

Yair — Wed, 12 Dec 2012 12:03:24 +0000

I think that the problem may be that the one-dimensional scale just doesn’t give you enough information. A score of 3 may be mean “far from brilliant, but will satisfy fans of the genre”, but also “the writing is very good, but the mediocre direction and acting hold it back”. These are quite different, but the system cannot distinguish between them.

By: Joseph Malkevitch

Joseph Malkevitch — Sat, 08 Dec 2012 14:28:19 +0000

I do especially like foreign films from the Middle East – in particular Israeli movies. Even though I have been lucky enough to travel outside the US a fair amount (though not to Israel) I think that foreign movies have the advantage that even if their plots are as weak as many American movies (and by the way, I also like Canadian and British “foreign movies” a lot) they get the advantage of my seeing locales, clothes, ways of life somewhat different from my own. This may result in higher ratings for foreign films.

The problem of having one person’s or a group of people’s rating of films be of use to other people has some similarities with trying to find strong papers in mathematical modeling competitions, which I have had some experience with “grading.” Again if one uses some numerical scale for ranking the papers how is one sure that X’s 4 points really indicates a superior paper (movie) to Y’s 3 points, since as with movies the numbers people assign are complicated amalgams on different scales of value? In these competitions since typically there is no time for all the judges to see all the papers a series of “triage” rounds occur to eliminate the weaker submissions. Since a judge can not go back and re-grade papers after seeing later papers there is a natural tendency to be “harsher” in the score on the first papers one sees because one wants to allow “room” for giving a truly remarkable paper a better score. This may be less of an issue for grading movies.

Getting back to Netflix a peculiarity I have noticed is that when recommending items in a particular category for me I might have thought Netflix would first those films that are given more stars for me, but that does not seem to be the case. Very often the items with more stars are not the earlier items in the list they show me.

By: Ariel Procaccia

Ariel Procaccia — Fri, 07 Dec 2012 19:46:36 +0000

This is interesting. On the one hand it is encouraging that you only rate movies shortly after seeing them, but on the other hand your taste in movies seems to be very different from mine, unless by “foreign language movies” you mean “Israeli movies”

By: Joseph Malkevitch

Joseph Malkevitch — Fri, 07 Dec 2012 13:27:45 +0000

I was born and raised in America and my way of using Netflix is to only rate movies I have seen via Netflix. Furthermore, almost all of the movies I watch are foreign language movies. By now I find that if Netflix claims that I will like the movie at the at least 4 stars level I nearly always am glad I saw the movie. I do occasionally watch an American movie (mostly on TV) and find relatively few of them to my liking.