An integration of the same kind of features has been tried also in the model used in this work, without giving significant improvements, but making model training much harder.
this direction has not been further investigated.