In this way, the output hidden representations (h 1 , h 2 , ..., h N ) can have the information from the input aspect (v a ).
in the following step that compute the attention weights, the inter- Aspect Embedding dependence between words and the input aspect can be modeled.