The average network latency per batch is 35 milliseconds, yielding a total latency of 0.8 seconds caused by the distributed language model for an average sentence of 22 words.
figure 4 shows perplexities for models with Kneser-Ney smoothing.