We experimented with both CNN and RNN for both sentence and document modeling, finding that the best development accuracies are obtained when CNN is used for sentence modeling and RNN is used for document modeling.
we choose this structure in Figure 1.