INT8 LLMs for vLLM
Collection
Accurate INT8 quantized models by Neural Magic, ready for use with vLLM!
•
50 items
•
Updated
•
17
Zhonghao Liu
pcpliu
·
AI & ML interests
None yet
Recent Activity
liked
a model
about 2 months ago
ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4
liked
a model
3 months ago
WarriorMama777/OrangeMixs
liked
a model
9 months ago
RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic
Organizations
None yet
upvoted
a
collection
about 1 year ago