The interaction of the parameters and the nonlinearity also makes the objective nonconvex.
our combined sparse and neural model trains on the Penn Treebank in 24 hours on a single machine with a parallelized CPU implementation.