Next, we will introduce how we obtain [a 1 , a 2 , ..., a N ] in detail.
for each h j , we use the following equation to compute scores on how well the inputs around position j and the topic distribution θ s match: where K is the number of topics, W a ∈ R d×K , U a ∈ R d×d and v a ∈ R d×1 are the weight matrices.