It may be possible to write GPU-specific code that maintains the entire parse state on GPU, but we are not aware of any such implementations.
our supertagger only uses matrix operations, and does not take any parse state as inputmeaning it is straightforward to run on a GPU.