Since the average sparsity level of human-annotated rationales is about 18%, we consider the following evaluation settings.
we compare the generated rationales to human annotations by measuring the precision when extracting 10% of words and the recall for 20% 6 .