The inaccuracy of the question is possibly caused by the use of a loss that is agnostic to sequence information.
given its decomposable nature, the cross-entropy loss on the ground-truth question or any of its (syntactically invalid) anagrams will be the same.