We consider the squared inner-product between v g and the debiased stereotypical or gender-neutral words as the loss, L g , as given by (4).
by applying the proposed method, we can further remove any residual gender biases from GN-GloVe, which shows that the proposed method can be applied in conjunction with GN-GloVe.