Future work could evaluate other implementations of LSA or use a higher-level view of speech, such as triphone state cluster ngrams, that more naturally exhibits sparsity and lends to tf-idf weighting.
weighting by a likelihood ratio test statistic and applying a log transform has generated better performance in several other tasks (Lapesa and Evert, 2014).