Hashimoto and Sassano (2018) used user responses to detect mistakes made by a deployed virtual assistant, showing that model mistakes can be identified in chit-chat, weather, or web search domains.
they did not explore how to use these identified mistakes to improve the model further; their agent was not equipped to feed itself.