Do you prefer reading stories written by men to get a better understanding of their fantasies, expectations and desires from their perspective, or as long as it's a good story do you not care if it was written by a man or woman?
I find male writers just tend to write more themes that I enjoy, though my favourite stories were done by someone I believe is a woman, though I'm not entirely sure.
Honestly, the gender doesn't matter so much as the subject and themes, and how well it's presented. I'm far more likely to be turned off by cliches or a writing style that doesn't sit well with me than the gender of the author.