You don't seem to understand that it's your very need to defend this point and mention it to others that makes people lash out at you. If you have proven that you are top 5 in doubles, and continue to do so, then you are, regardless of what everyone says. Let them speak slander and jest, it shouldn't matter to you because you're going to be beating them anyway. By taking their bait, you just bring more of it on yourself.
Unfortunately this problem isn't fixable by getting everyone else to stop, b/c there are hundreds of everyone else, but just one of you. If you want people to stop haranguing you, you have to stop feeling the need to justify yourself or your skill, until then it's going to keep happening, which will just cause more people to lash out at you.