Although we could in principle perform word discovery directly on speech, we leave this for future work, and only explore singletask and reconstruction models.
in the speech experiments, the decoders output the sequences at the grapheme level, so the output embedding size is set to 64.