As a sanity check, both architectures outperform a language-agnostic model on an accuracy-based colorization metric.
we are more interested in whether modifications to the caption properly manifest themselves in output colorizations (e.g., switching one color with another); crowdsourced evaluations confirm that our models properly localize and color objects based on captions ( Figure 1).