Therefore, the proposed FCWM plays the role of the function ϕ parameterized by θ 1 , which maps the context L j of each word into vector V L j as follows: Compared with the FCWM, the proposed CCWM indirectly encodes the context words of each word as a compositional semantic representation to represent the OOV.
the proposed CCWM is a novel variant of the standard convolutional neural network (Collobert et al., 2011), including an input layer, a convolution layer, a pooling layer and a non-linear output layer, as shown in Figure 2 (b).