In a sense, W2V-AVG does well on passive sentences for the wrong reasonsrather than understanding that the semantics are unchanged, it simply observes that most of the words are the same.
we still see the trend that performance goes down as the number of reference  sentences increases.