We call this metric the mean average recall@k: where R@k = #cognates within top-k results #cognates in Y , where Q is the number of queries, and L is the number of language pairs.
for each word query q, we rank the pairs (q, y i )∀i and get the top 100 words y for each q.