Our language model is implemented on a GPU, but its general design (and much of the actual code) is likely to be useful to other hardware that supports SIMD parallelism, such as the Xeon Phi.
let Σ be a our vocabulary, Σ n the set of all n-grams over the vocabulary, and Σ [N ] the  Federico et al.