An alternative to RNTNs would be to make the compositional function more powerful by adding a second neural network layer.
initial experiments showed that it is hard to optimize this model and vector interactions are still more implicit than in the RNTN.