We find that there are configurations that achieve good performance across the splits.
the best overall configuration, found by minimizing ranks across splits, has 0.01 learning rate, 25-tokens batch size, 0.25 dropout, 6 layers, 512 layer dimensionality, and kernels of width 5.