All the activation functions for the FUTURE layer obtain BLEU score improvements: GRU +0.52, GRU-o +1.03, and GRU-i +1.12.
gRU-o is better than  Table 2: Case-insensitive BLEU on Chinese-English Translation.