This is expected, as described in Section 3, because using raw bit arrays causes many one-off estimation errors at the output layer due to the lack of robustness of the output representation.
hybrid-N and Binary-EC models clearly improve BLEU from Binary, and they approach that of Softmax.