Orthogonal Matrix Factorization (OrMF) (Guo et al., 2014) is the extension of WMF, with an additional objective to obtain nearly orthogonal dimensions in matrix factorization to discount redundant information.
for the (vec) version, vectors of a pair of sentences v 1 and v 2 are converted into one feature vector, , by concatenating the element-wise sum v 1 + v 2 and absolute differ- We also provide the (sim) variation, which directly uses the single cosine similarity score between two sentence vectors.