That's not unreasonable at all. OoT was a great game, and I found it more fun that any of those games you listed (that I played). It's an opinion.
Not arguing it is a great game but it was revolutionary nor did it sell as well as other games. It was the start of the modern LoZ era though and TP and WW are just follow ups of what Ocarina did.
However, when you look at the dominance of early games and also the PC games you have to see that other good games where out there.
Doom for example really start the FPS (Wolfenstein predated it but wasn't as popular or as big a hit) and Halo and all those games can trace back to what Doom started.
Mario Brothers 3 was by far the best platform game created of the Mario series.
Civilization II and Sim City started a new strategy and rpg that had never seen before. Before these games rpg was simple go on quests/fantasy games. They birth a whole other category that eventually led to the Sims.
Age of Empires - although Warcraft is the parent of RTS, Age of Empires really popularized it, and if you haven't played this series (or Warcraft/Starcraft as well) you are missing out.
Pacman and Pong also deserve a worthy mention. I played Ocarina and have it on Virtual Console and think it is a great game, but not the best all-time. The N64 didn't even do that well, so it shows that at the time the games for N64 lagged behind Playstation.