AmpereComputing/qwen-2.5-0.5b-instruct-gguf
0.5B
•
Updated
•
13
Qwen 2.5
Ampere's quantization formats (Q4_K_4 / Q8R16) require Ampere optimized llama.cpp available here: https://hub.docker.com/r/amperecomputingai/llama.cpp
-
-
AmpereComputing/qwen-2.5-1.5b-instruct-gguf
2B • Updated • 31 -
AmpereComputing/qwen-2.5-3b-instruct-gguf
3B • Updated • 62 -
AmpereComputing/qwen-2.5-7b-instruct-gguf
8B • Updated • 8 -
AmpereComputing/qwen-2.5-14b-instruct-gguf
15B • Updated • 16 -
AmpereComputing/qwen-2.5-32b-instruct-gguf
33B • Updated • 12 -
AmpereComputing/qwen-2.5-vl-3b-instruct-gguf
3B • Updated • 298 -
AmpereComputing/qwen-2.5-vl-7b-instruct-gguf
8B • Updated • 101