Not liking a group because of fandoms

Genuinely question for people that don’t like groups because of the fandom.

You can listen to a group and not participate in the fandom, you can block problematic accounts and you can curate (algorithm) your timeline accordingly.

I am going to be honest, to me sound like people are casual listening instead. You don’t have to announce to the world. It is laughable.

So why? Does the fandom really matter?

Thank you,