Note that our baseline discrete model and neural model have highly similar structures, differing mainly in the use of manual discrete features and automatic neural features.
the discrete feature vector f = n i=1 f i can be regarded as being obtained by using a sum pooling function Here f i is a discrete feature vector with manual feature engineering.