(2015) further show that enforcing the linear mappings to be orthogonal matrices achieves higher performance.
we let our encoders M l be orthogonal linear matrices, and the corresponding decoders can be obtained by simply taking the transpose: Thus, applying the encoder or decoder to an embedding vector is accomplished by multiplying the vector with the encoder/decoder matrix.