The PEAK (Yang et al., 2016) method for evaluation automates the extraction part of the SCUs, and they use the ADW (Align, Disambiguate and Walk) algorithm (Pilehvar et al., 2013) to compute semantic similarity.
their approach fails to model contradiction, paraphrase identification and other features like natural language inference.