The counts are collected seperately for each position by keeping track of four seperate vectors for positions -2, -1, +1 and +2.
each vector is a sparse vector, having the # of dimensions as the size of source language vocabulary.