Being a part of many large fanbases, I wouldn't say most fanbases are entirely or even mostly bad.
Just do your best to ignore the crappy parts of the fanbase, because if the fanbase in question is a sizeable one, there's gonna some toxicity of different flavors within it. When it comes to my interests and hobbies, I try to stick to a motto, that motto being "Never let someone else ruin something for you."
I see Minecraft get a lot of hate nowadays, and as a long time fan of it, I find that disheartening. If you don't like the game that's perfectly fine, but most of the hate seems to stem from overexposure and the many immature children who play it. Those aren't faults of the game itself.