The relevant sense of transparency, as defined by Lipton (2016) ( §3.1.2), pertains to the way in which a specific portion of a model corresponds to a human-understandable construct (which Doshi-Velez and Kim (2017) refer to as a "cognitive chunk").
additional future directions for this line of work include application on other tasks such as sequence modeling and multi-document analysis (NLI, Qa); extension to languages other than English; and adding a human evaluation for examining the level of agreement with our measures.