I'm not a Organized Crime expert, as I haven't been in any Criminal Organization or any gangs, but from what I've read and seen on the internet I want to say this is kind of accurate
When it comes to Organizations like the Yakuza, or even other organizations, Most of the violent efforts are towards other Criminals, or Rivals of the particular organization, as they tend to either mess with the organization or their money. Of course there are many examples where Innocent people are caught in the crossfire, whether unintentional or intentional, and especially if it's for monetary reasons like extortion, ransoming, or human trafficking (I know Cartels specialize in this type of thing, don't know about the Yakuza) but you don't just want to mess with Innocent people for no reason, as they usually are the people that these organizations rely on for revenue.
In particular, I do believe that the Yakuza do help out some of the poorer communities. even the Government has relied on the Yakuza protecting communities like this from what I heard
and as for Saving women, perhaps that's a thing too.
Of course, they are very destructive in the end, both towards people outside the gang, Innocent or guilty, and even people inside the gang, as this type of lifestyle is one that's very hard to live, especially if you were unwilling or forced to join. In any case, I think the Yakuza game is kind of correct in portraying that Kiryu is a criminal, despite doing things like Saving women and beating up criminals, because not everything is black or white. I also haven't played the game so I don't know what Kiryu is thinking when he's doing these actions.