ubergarm
/

Kimi-K2-Thinking-GGUF

Text Generation

Model card Files Files and versions

Resources

View closed (1)

smol_iq3_ks

#14 opened 23 days ago by

Q4_X perplexity?

#13 opened 24 days ago by

Quant in the 320GiB and 360GiB range?

#11 opened 29 days ago by

Output not respecting lines breaks?

#10 opened 29 days ago by

the faster the inference speed becomes. Why is that?

#9 opened 30 days ago by

Testing smol-IQ4_KSS

#8 opened about 1 month ago by

IQ4_KSS

#7 opened about 1 month ago by

Imatrix from BF16 ?

#6 opened about 1 month ago by

Benchmarks (Q8_0-Q4_0, RTX 5090, EPYC)

#5 opened about 1 month ago by

IQ3_K Discussion.

#4 opened about 1 month ago by

IQ2_KS

#3 opened about 1 month ago by

Q4_0=INT4?

#2 opened about 1 month ago by

Definitely interested in this one!

#1 opened about 1 month ago by