On GEO and ATIS, the copying mechanism helps significantly: it improves test accuracy by 10.4 percentage points on GEO and 6.4 points on ATIS.
on OVERNIGHT, adding the copying mechanism actually makes our model perform slightly worse.