2017, which employs the algorithm in a supervised learning setting.
while an encoder-decoder critic model Q ω as a substitute for the true Q function in Eq 3 enables taking the full expectation (because the critic model can be queried with any stateaction pair), we are unable to obtain reasonable results with this approach.