First, we build a word pattern matrix F w with binary values based on observations, where each row represents an utterance and each column refers to an observed unigram.
f w carries the basic word vectors for the utterances, which is illustrated as the left part of the matrix in figure 1(b).