Formally, we have where W in and W rec are weight matrices for the input and recurrent connections, respectively.
note that we did not try the latter three channels alone, because each single of them (e.g., POS) does not carry much information.