Additionally, we see that the inclusion of a text-specific speech encoder S2T degrades performance: compare for exam-ple row 6 to 7, and row 11 to 12.
the linear mappings I2S and I2t project 4096 dimensions down to 1024.