However, as segmentation accuracy improves, the tokens behave more like true words and the retrieval engine begins to behave more conventionally.
after a point, when the second regime is reached, retrieval performance no longer increases with improved segmentation accuracy, and eventually begins to decrease.