We set the cardinality regularization λ 1 between values {2e − 4, 3e − 4, 4e − 4} so the extracted rationale texts are neither too long nor too short.
the rationale for a given sequence x can be equivalently defined in terms of binary variables where each z t ∈ 0, 1 indicates whether word x t is selected or not.