The motivation of this subnet design comes from that the prediction confidences from different frames should be different, e.g., it is more difficult for a frame near the start point to detect the end point than a frame near the end point.
we set the ground truth confidence of each frame based on its "centerness" in the segment.