FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM!
•
44 items
•
Updated
•
76
Aditya Kulshrestha
Aditya02
·
AI & ML interests
None yet
Recent Activity
liked
a model
2 days ago
kenpath/svara-tts-v1
published
a model
2 days ago
Aditya02/FastSpeechHS_2
liked
a model
about 1 month ago
PleIAs/Baguettotron
Organizations
upvoted
a
collection
over 1 year ago