To solve the problem, we extend the RNNTSM model with factorizing tuples in input layer, as shown in Figure 2(a).
it consists of an input layer x, a hidden layer h (state layer), and an output layer y.