In order to examine the contribution of both the aligned and unaligned APTs in the composition process, we used a hybrid method where the composed representation is defined as:   In the case where representations consist of APT weights which are probabilities, PPMI is estimated after composition.
we refer to this as compose-first (CF) in contrast to composesecond (CS) where composition is carried out after PPMI calculations.