They are computed as follows: In our experiment, the average number of candidates for each query is about 53.
we extracted 50 candidates from clickthrough logs and then reranked using three methods: 1.