Depends on what "matter" means. For the goals of the individual VCs making themselves more money, sure, agreed. And perhaps also for the goal of making as many (financially) successful tech companies as possible, without regard to what those companies do.

But for the goal of improving society by this investment, instead of worsening it? A successful neo-Nazi VC would be terrifying.