Ideally, the vector softmax(o t ) in a well-trained SDN is close to an one-hot vector.
m • softmax(o t ) should be close to one column in m and we can view that m provides at most D different "embedding vectors" for RNN1 as inputs, indicating at most D different subgoals.