In our experiments C(•, •) was a linear layer with discretized inputs (i − pos w , i − pos v ) which were transformed into two binary vectors of size wsz, where a bit is set to 1 if it corresponds to the position to encode, and 0 otherwise.
we discuss this further in Section 5.2.