The node state vector h t is generated using a modification of the standard LSTM equations to include both hierarchical and timing structures for each comment.
we use two forget gates -one for the previous (or subsequent) hierarchical layer, and one for the previous (or subsequent) timing layer.