Looks like some good stuff is going on in this thread. Haven't read through a lot of the text, though I've read through some of it.
A couple obvious things I want to note here:
1. Bias shouldn't be much of an issue. There are several panelists for a reason, so you guys shouldn't really worry about it too much.
That's the hope. We've run into some problems this time though, caused by a problem area of the PR involving almost the entire panel...
2. It's good of you guys to just look at the wins/losses. Just be sure to be smart about it (I'm sure you guys are, though). Also, I hope you guys are noting who lost to who and who won against who.
I think your last sentence there is kind of a given, TBH. =P Looking at who beat who and who lost to who is synonymous to the concept of looking at wins/losses IMO.
3. For a small, but rising community like this, I'd scope out the last several tournaments, maybe around 2-4, and update accordingly. Keeping track of anymore makes it too statistical and really defeats the purpose of panelists IMO. This is just a general suggestion though. I don't really know how you guys actually go about updating this.
Agreed. In short, we look at the brackets, look for players with good wins, and compare their wins/losses/overall consistency with each other to get a good idea of where they belong. If a group of players is really close together, we take a closer look at their wins and losses and try and make a decision based off that.
4. Plain and simple, the PR is an ego list. **** drama, and **** trash talk. Have an argument about why you should be higher than someone? Win next time.
Yessssssssssssssssssssssssssssssssssssss
5. Don't even worry about delays with updates. Updates will happen eventually. At times our Melee PR has walked into walls without updates because we can't come up with a solid, agreeable list.
I hope the rest of the community sees it like this, because this is going pretty slowly. :x
#4 is a bit blunt, but that's how i really feel tbh.
I'm pretty sure I left some stuff out, but whatever. I'm kinda tired anyways.
Anyways, keep up the good work, guys.