If this is not the case and the lower layer does not detect a boundary, the layer runs COPY.
if the lower layer does detect a boundary z −1 t , it runs UPDATE: if z t−1 = 0 and z −1 Output gate -The output embedding h e t of the HMLSTM is computed by the following gating mechanism: h e t = ReLU(g t W e h t ) It takes states from the three layers and computes a gating value for each g 1 t , g 2 t and g 3 t using the parameter vector w .