SD 2 : This model again uses a relaxed version of the orthogonality constraint used in D 2 .
we define a gating parameter g t and replace (12) above by (14) as define below: where We compare with two recently proposed baseline diversity methods (Chen et al., 2016) as described below.