The architecture (summarized in Figure 2c) is basically composed of an ASR module which maps speech to text, followed by the text-image system we just described (our NLU component).
it is not clear how an end-to-end approach compares to a traditional pipeline-based approach when one has access to transcriptions.