【bug】During testing, the response content kept repeating
#4
by
meitianjinbu
- opened
【bug】During testing, the response content kept repeating
This may be because you did not use skip_special_tokens=False when using it, resulting in the failure to decode , creating an illusion of repetition, as this part of the content should be within the thinking section. You can update the model tokenizer_config file or add skip_special_tokens=False