A slightly more sophisticated way is to jointly consider the ASR/MT and language model in a beam search decoder (Amodei et al., 2016).
at each time step, the decoder appends every symbol in the vocabulary to each sequence in the current candidate set.