We formulate the process of crafting adversarial examples in neural image captioning systems as optimization problems with novel objective functions designed to adopt the CNN+RNN architecture.
our objective function is a linear combination of the distortion between benign and adversarial examples as well as some carefully designed loss functions.