For fair comparisons, we set the total amount of neurons in our model to be same with vanilla LSTM.
the more groups we split, the less the neurons belongs to each group, which leads to a worse capacity than those who have sufficient neurons for each group.