To alleviate this problem, some models such as NTNs (Socher et al., 2013a) have explored 3D tensors to yield more expressive mapping: The output of this mapping is an array of k bilinear products in the form of x T 1 W [i] x 2 .
this is also a transformation from R 2n to R k .