This suffices to compute interval bounds for feedforward networks and CNNs.
common NLP model components like LSTMs and attention also rely on softmax (for attention), element-wise multiplication (for LSTM gates), and dot product (for computing attention scores).