Although formally syntactic, such models rarely respect linguistically-motivated syntax, and have no formal notion of semantics.
they tend to produce translations containing both grammatical errors and semantic role confusions.