We also note that the correlations are higher for the inference network than for gradient descent, showing the impact of amortization during learning of the inference network parameters.
since we are learning to do inference from a dataset, we would expect search error to be smaller for more frequent sequences, and we do indeed see this correlation.