Note that the supervision signals P O (S|F * , Θ O ) and P L (F|S * , Θ L ) do not rely on any supervised parallel corpus.
similar to the application of dual learning paradigm on NMT task (Xia et al., 2016), it is theoretically possible to use unparalleled sentences and sets of facts to compute these signals.