Smaller tied+L models perform well compared to larger tied models.
the tied+L model with 600/400 units has perplexity of 76.0, compared to 76.1 of the tied 600/600 model, with 55% the number of parametres.