a series of differentiable transformations h k : where z k is the vector of activations in the k-th layer and the final output z K consists of the logits for each class.
the specification against which we verify is that a text classification model should preserve its prediction under character (or synonym) substitutions in a character (or word) based model.