In addition to edge inputs, a cell also takes the hidden states of its incoming and outgoing words during a state transition.
the states of all incoming words and outgoing words are summed up, respectively: Based on the above definitions of x i j , x o j , h i j and h o j , the recurrent state transition from g t 1 to g t , as represented by h j t , is defined as: where i j t , o j t and f j t are the input, output and forget gates, respectively.