Forum

So how'd the ranked-pairs experiment turn out? Think you'll stick with it?

The final positions for the cumulative rankings look sensible but I think there were problems with the weekly cumulative results at times throughout the season.

This is apparent when you look at Gushing Over Magical Girls, which has moved significantly in the rankings over the season. Its average ranking for the first 6 episodes was 22nd and its average ranking for episodes 7-13 was 8th. Its closing position of 13th looks accurate but the weekly cumulative results are understated at times, particularly in weeks 10 and 11 when it gets stuck down at 20th and 19th despite being ranked 9th and 4th respectively in the weekly numbers.

My guess is this is because the calculation methodology was applied inconsistently throughout the season. It raises questions about whether the cumulative calculations were updated some of the weeks.

Man I've been intending to watch Dangers in My Heart for a while now but after seeing how consistently it dominated other stuff is gonna motivate me to get off my butt and... well, get back on my butt and watch the show already.

Of course, it doesn't hurt that I'm not terribly interested in a lot of the new shows this season thus far.

James949693 wrote:

The final positions for the cumulative rankings look sensible but I think there were problems with the weekly cumulative results at times throughout the season.

This is apparent when you look at Gushing Over Magical Girls, which has moved significantly in the rankings over the season. Its average ranking for the first 6 episodes was 22nd and its average ranking for episodes 7-13 was 8th. Its closing position of 13th looks accurate but the weekly cumulative results are understated at times, particularly in weeks 10 and 11 when it gets stuck down at 20th and 19th despite being ranked 9th and 4th respectively in the weekly numbers.

My guess is this is because the calculation methodology was applied inconsistently throughout the season. It raises questions about whether the cumulative calculations were updated some of the weeks.

I can't comment on the numbers but I would be curious to know if there was a large increase in the number of votes per episode starting at that point. Folks got mad about a joke in one of Chris' reviews (that he acknowledged in the subsequent review) and it led to a lot of negativity and vitriol on social media. I wouldn't be surprised if some of those folks were motivated to vote on the episodes with higher rankings than what it got prior.