To distill the complementary information from the structural feature s i , inspired by LSTM, an input gate is designed to eliminate the information in s i that has already appeared in t i .
the gate is designed as where σ(•) is the sigmoid function; denotes the element-wise multiplication; P and b g are used to align the structural feature s i to the space of textual features t i .