 Recently, Wang et al. (2019b) propose to stack an ASR encoder and an MT encoder as a new ST encoder, which incorporates acoustic and linguistic knowledge respectively.
the gap between these two encoders is hard to bridge by simply concatenating the encoders.