In order to exploit nonlinear connections, we learn the parameters φ of f via a simple linear layer followed by sigmoid activation.
we train a new model that learns how to best combine the predictions from subword models.