Slhoka
Smash Lord
2010 Real Tier List Project
Since the previous attempts of tier list creation ended up being failures, I think we could do as Marc suggested and use a simple vote just like we did to create the current PAL Tier List. The main issue of the previous list projects was the effort required by the voters. We asked for an amount of participation that obviously couldn't overcome the laziness of most MBR members. That's where the PAL tier list system could save us.
How was the PAL tier list created ?
Before the vote, we gave a coefficient to every PAL country with a relevant Melee scene. This coefficient was based on the activity of the scene, as well as its activity and overall level. Then we chose a representative for every country, who himself chose a number of voters for his own country, according to the coefficient given to the country.
Then we asked all 33 voters to rank all 26 characters without any tier separation. After gathering all the votes we originally planned to discuss the debatable results and then re-vote, but since the average list looked pretty good we decided to let it stay like that. We just added separations where the data we had showed us a gap between two characters.
If you want to know more about this, check the PAL Tier List thread or the aggregated results file (PDF).
How can we adapt this to the NTSC list ?
Creating a NTSC list this way is actually more convenient. I think that separating the voter by region isn't even necessary unless we want to get input from Japan and Latin America, it was only needed in Europe because of the many differences between the various communities.
Another question is: do we want to get votes from MBR members only, or should we also establish a list of skilled and knowledgeable people who are not members but could vote too? I'm in favor of the second solution but I'd like to know what you guys think.
We also need to define a threshold to avoid posting a list which is the result of a few people's opinions only. The MBR has 67 members (actually a bit more, Cactuar's list isn't totally up to date). Out of these, I'd say that 40-45 votes would be good. This has to be discussed of course, and the threshold should be different if we ask people who are not in the MBR to vote, and once we take into account MBR members who want to abstain (like me, as I think I'm not knowledgeable enough on high-level play to make a relevant choice).
What do we have to do now?
We can only start after we take a decision on the two problems I mentioned above. Once we do know what to do about that we'll launch the actual voting process. I'm willing to take care of the results. I'll do the rest if no one wants to, but if anyone wants to take care of this, I wouldn't mind at all.
My objective is to be done with this project in less than 2 months, ideally one.
Since the previous attempts of tier list creation ended up being failures, I think we could do as Marc suggested and use a simple vote just like we did to create the current PAL Tier List. The main issue of the previous list projects was the effort required by the voters. We asked for an amount of participation that obviously couldn't overcome the laziness of most MBR members. That's where the PAL tier list system could save us.
How was the PAL tier list created ?
Before the vote, we gave a coefficient to every PAL country with a relevant Melee scene. This coefficient was based on the activity of the scene, as well as its activity and overall level. Then we chose a representative for every country, who himself chose a number of voters for his own country, according to the coefficient given to the country.
Then we asked all 33 voters to rank all 26 characters without any tier separation. After gathering all the votes we originally planned to discuss the debatable results and then re-vote, but since the average list looked pretty good we decided to let it stay like that. We just added separations where the data we had showed us a gap between two characters.
If you want to know more about this, check the PAL Tier List thread or the aggregated results file (PDF).
How can we adapt this to the NTSC list ?
Creating a NTSC list this way is actually more convenient. I think that separating the voter by region isn't even necessary unless we want to get input from Japan and Latin America, it was only needed in Europe because of the many differences between the various communities.
Another question is: do we want to get votes from MBR members only, or should we also establish a list of skilled and knowledgeable people who are not members but could vote too? I'm in favor of the second solution but I'd like to know what you guys think.
We also need to define a threshold to avoid posting a list which is the result of a few people's opinions only. The MBR has 67 members (actually a bit more, Cactuar's list isn't totally up to date). Out of these, I'd say that 40-45 votes would be good. This has to be discussed of course, and the threshold should be different if we ask people who are not in the MBR to vote, and once we take into account MBR members who want to abstain (like me, as I think I'm not knowledgeable enough on high-level play to make a relevant choice).
What do we have to do now?
We can only start after we take a decision on the two problems I mentioned above. Once we do know what to do about that we'll launch the actual voting process. I'm willing to take care of the results. I'll do the rest if no one wants to, but if anyone wants to take care of this, I wouldn't mind at all.
My objective is to be done with this project in less than 2 months, ideally one.
