This suggests that the information about the gender is deeply embedded in the representation and is not easy to remove in a post-processing phase.
zeroing the projection of a word's vector on the gender direction is not enough in order to remove all gender information from the word's representation.