All other functions perform considerably worse.
the top-performers are all saturating functions, indicating the different roles activation functions play in LSTMs-those of gates-compared to standard layers.