The regularisation formula is ||W W −I|| F , where ||•|| F is the Frobe-nius norm.
1 Specifically, the update rule (Cissé et al., 2017) for the regularisation is: The usage of the decoder during training and testing is defined as follows: the decoder is also utilised after learning to serve as a linear encoder in addition to the RNN encoder.