Where S is a non-empty set of ordered word pairs (x, y) that define the association, b is the first principal component of { x − y | (x, y) ∈ S}.
(2016) suggested, word embeddings should not be normalized before debiasing, as vector length can contain important information (Ethayarajh et al., 2018).