We demonstrate improvements over previous models on perplexity and downstream tasks, and offer qualitative analysis of learned discursive patterns.
for this analysis, we specifically focus on DDTM trained with 64 bits total.