Our approach exhibits small GPU memory footprints, due to reductions of the arithmetic complexity (with fewer intermediate results to keep) and trainable parameter size (with fewer parameters to store).
com/uclanlp/ELMO-C. Contextual representation We review contextual representation models from two aspects: how they are trained and how they are used in downstream tasks.