The speaker state tracker in our model accumulates the user information as the conversation evolves.
we directly concatenate the speaker state vector h t and the local speaker mode vectorũ t as the user embedding vector at user turn t. Other than using more turns, this is the same DynamicSpeaker-Model configuration as in §3.3.