Why can't God be female?

Perhaps God is a hermaphrodite or maybe God is neither.

In any event, what does God's gender matter? I've seen people vehemently deny God's femininity but the concept shouldn't matter to real believers right? So God could be female, male, a hermaphrodite or neither.

So what's wrong with believing God is female?