Witchfire Preyer Theory

Just a small theory I had, what if the reason the Preyer's wear their masks is because they're all women?

As far as I'm aware, there are no instances of male witches as all the spells describe witches as female. This could mean that in-universe, only women are capable of using spells.

The church, as a patriarchy, would be embarrassed that their best weapon against the witches are women, who are essentially witches in themselves. They would require them to wear masks to hide this fact.

What does everyone else think?