Note that even if the magnitudes of sentence representations are not normalized, the debiased representations are still pointing in directions orthogonal to the bias subspace.
skipping the equalize step still results in debiased sentence representations as measured by our definition of bias.