After a day of operation, I realized the site was way too swingy. The problem was that each user could vote once for each pair of characters. The average change in character position was 16 points - so with 100 characters, a single user could swing a character by over 1600 points in a single day.
I've changed the system a bit. First of all, I've changed the way we calculate k, which controls the amount of change per vote. Now, it's 32 (for an average change of 16) when the character has less than 50 votes, and 16 (8) after that. This should limit the amount of change that happens.
Next, I've changed things so that a person can only vote for or against a given character once per day. This means that a single person can only change a character's rank by a maximum of 32 points per day - and 8 or less is more likely, once things stabilize. I'd like MoéMash to reflect community rather than individual opinion, and hopefully these changes will improve that.
Since the rating formula changed, I reset every character's rating to 1500. Hopefully, I won't have to do that again. (But we are still in beta.)
but it was so much fun having my top 5 all in order :<
ReplyDelete