I completely agree.
The most important stat is speed. If you don't have speed, you're already at a disadvantage. But, if you can camp well, then you can at least get around the lack of speed with solid camping leading to a good neutral.
Unfortunately for Ganon, he lacks ANY projectiles. So it's condemning on multiple fronts.
The only reason why he's NOT a low tier in Melee and is a mid tier instead is because that game is quite unbalanced and there are a lot of low tiers in that game. If they released an HD version though? Ganon would probably fall to low tier. If they just made Mario and Young Link's KO setups work properly, those are two characters already certainly better than Ganon. If you buff G&W's shield and fix L-cancelling all of his moves, that's another character that would make Ganon sweat in a balance patch.
I feel bad for Ganon a lot, really. I like his character, man.