Each row of the bigram matrix can be seen as a bigram vector that shows the scores of all bigrams in which the word represented by that row occurs as the first word.
the words representing the rows of the bigram matrix make the feature set while the words representing the columns form the dimensions of the feature space.