This may be due to the fact the quality of information contained in the gold labeled data deteriorates.
using the right amount of weekly-supervision is an important hyper-parameter that needs to be carefully chosen.