Jeremy Lam

whoisjeremylam's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in ubergarm/Kimi-K2-Thinking-GGUF about 15 hours ago

Output not respecting lines breaks?

12

#10 opened 28 days ago by

justj0sh

New activity in ubergarm/Kimi-K2-Instruct-GGUF about 15 hours ago

IQ2_KS passes the Moonshot K2 Vendor Verifier test

🔥 3

4

#8 opened 6 days ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Instruct-0905-GGUF about 1 month ago

IQ2_KS

79

#1 opened 3 months ago by

gghfez

New activity in cpatonn/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit about 1 month ago

Strange warning on first completion w/ vLLM 0.11.0

#6 opened about 1 month ago by

whoisjeremylam

New activity in zai-org/GLM-4.6 about 1 month ago

How to stop reasoning?

3

#16 opened about 2 months ago by

yuchenxie

New activity in cpatonn/GLM-4.5V-AWQ-4bit about 1 month ago

Best local VLM so far that I've found that fits in 96 GB of VRAM

#2 opened about 1 month ago by

whoisjeremylam

New activity in Intel/GLM-4.6-gguf-q2ks-mixed-AutoRound about 2 months ago

Model quality relative to other quantization techniques?

1

#1 opened about 2 months ago by

spanspek

New activity in Intel/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound about 2 months ago

Inference with llama.cpp + Open WebUI gives repeating `?`

4

#1 opened about 2 months ago by

whoisjeremylam

New activity in cerebras/Qwen3-Coder-REAP-25B-A3B about 2 months ago

Aider Polyglot Benchmark

👍 1

1

#1 opened about 2 months ago by

whoisjeremylam

New activity in Intel/Qwen3-Next-80B-A3B-Thinking-int4-AutoRound 3 months ago

Difference between int4-mixed and int4

1

#1 opened 3 months ago by

whoisjeremylam

New activity in ubergarm/DeepSeek-V3.1-GGUF 3 months ago

quant req: 256 GB RAM + 96 GB VRAM

👍 1

28

#1 opened 4 months ago by

whoisjeremylam

New activity in ubergarm/Kimi-K2-Instruct-GGUF 3 months ago

Neglible loss of PPL when using only 6 of 8 experts

🔥 2

3

#7 opened 3 months ago by

whoisjeremylam

liked a model 3 months ago

meituan-longcat/LongCat-Flash-Chat

Text Generation • 562B • Updated Sep 24 • 22.1k • 508

liked a model 4 months ago

ubergarm/DeepSeek-V3.1-GGUF

Text Generation • 671B • Updated Aug 24 • 307 • 11

New activity in unsloth/DeepSeek-V3-GGUF 9 months ago

Dynamic quants

3

#13 opened 10 months ago by

XelotX

liked a model about 1 year ago

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 17, 2024 • 268 • 46