I was a fan of the old school panel of respected judges who got together and voted on the best players
then the smash community got super scrubby and everyone complains and everyone wants to avoid hearing people moan so we just dodge the issue.
Anyway just out of interest and boredom I used an ELO rating program to calculate elo in Smash 4 based on HASLfest 8, HASLfest 9, and Birmingham Brawl. That's not a lot of matches, so the ratings are very volatile right now, so don't take this super seriously at the moment.
Adding HASLfest 10 and 11 will almost certainly provide a much different picture. i'm not sure if I should add hidden power since smash 4 isn't big in mobile and the rest of AL doesn't travel there really.
In case you don't know how ELO works, You start at an arbitrary rating, I started with 1000. This is arbitrary, but you have to start somewhere. When you win, you gain points. When you lose, you lose points. If you win against a good player you gain more points than you would if you win against a bad player. Likewise, if you lose against a good player you lose less points than you would if you lost against a bad player. So if some random kid shows up and takes out Spade, Mahg, and Reflex, his ELO is going to skyrocket. and if a top players loses to some random they are going to lose a lot of points. It will take many matches to normalize what a "good" or "not good" player is, which is why i said don't take this current image too seriously. Everyone started at 1000 elo, so winning round 1 of the first tournament considered gave everyone the same amount of points regardless of the opponent. The actual mathematical formula is complicated and can vary, but that's how it works. ELO does not give a damn what you placed in the tournament, all it considers is who you beat. Obviously if you make it far in a tournament though, that means you beat more people meaning you get more points and lost to less people meaning you lost less points.
The issues with ELO system are as I mentioned, intangibles. It doesn't take into account if someone is sick or tired or has a broken controller or was distracted or accidentally SD'd or got DQ'd etc. If you lose you lost points, period. Another issue (maybe) is that losing match is worse than not playing a match. Reflex for example has by far the highest ranking by winning HASLFest 9. If he never attended anymore tournaments, it's likely he'd still be ranked very high just from that one tournament, since he's not losing any points (although he'd eventually be surpassd).
Other stuff: Airboystool should be airboysteel obv
If someone entered two tournaments with two different names, they will have two different ELOs. I can't be bothered to try and keep up with that ****.
Anyway, i find this very interesting and will probably keep it up for my own amusement at the very least.
ELO is not a Power Rankings list. It updates and changes after every tournament. So if you guys wanted to put together a more general, "who are the top players" list that lasts longer than a month, that would also make sense.