This relationship is however not expressed through the tying of the corresponding parameters; instead we let the prediction space guide the convergence of the context space.
the LBL model estimates the n-gram parameters by: In this equation, E is an energy function defined as: where R is the projection matrix introduced above, (v k ) l−n+1≤k≤l−1 are the 1-of-V coding vectors for the history words and v l is the coding vector for w l ; C k ∈ R m×m is a combination matrix and b r and b v denote bias vectors.