The oracle approach to PP attachment differs from many other tasks in NLP like part-of-speech tagging or parsing, in which usually no data based on manual annotation are part of the input.
published evaluation results for tagging and parsing accurately reflect the performance we would expect in an application whereas PP reattachment results arguably do not.