How to quant this model?

#1
by ShaneSue - opened

Hi there, I am interested in model quant, but I do not have a great tool to do it , I found the config.json has no quant param, so is there tool to do that?

Sign up or log in to comment