QuantFactory/OpenCoder-8B-Instruct-GGUF
Text Generation • 8B • Updated
• 391 • 6
Ollama-ready Coding Models
For inference. CPU is enough for both quantization and inference.
-
-
QuantFactory/OpenCoder-8B-Base-GGUF
Text Generation • 8B • Updated • 266 • 3 -
bartowski/starcoder2-15b-instruct-GGUF
Text Generation • 16B • Updated • 284 • 5 -
QuantFactory/starcoder2-15b-GGUF
Text Generation • 16B • Updated • 136 • 2 -
bartowski/starcoder2-15b-instruct-v0.1-GGUF
Text Generation • 16B • Updated • 736 • 8 -
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Text Generation • 16B • Updated • 38.6k • 132 -
QuantFactory/starcoder2-7b-instruct-GGUF
Text Generation • 7B • Updated • 143 • 1 -
QuantFactory/starcoder2-7b-GGUF
Text Generation • 7B • Updated • 393 • 3 -
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF
3B • Updated • 61 • 1 -
QuantFactory/starcoder2-3b-instruct-GGUF
Text Generation • 3B • Updated • 179 • 1 -
QuantFactory/starcoder2-3b-GGUF
Text Generation • 3B • Updated • 181 • 3 -
Qwen/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation • 33B • Updated • 157k • 189 -
bartowski/Qwen2.5-Coder-32B-GGUF
Text Generation • 33B • Updated • 1.49k • 18 -
Qwen/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation • 15B • Updated • 40.8k • 97 -
mradermacher/Qwen2.5-14B-Coder-Merge-GGUF
15B • Updated • 63 • 2 -
Qwen/Qwen2.5-7B-Instruct-GGUF
Text Generation • 8B • Updated • 49.4k • 129 -
QuantFactory/Qwen2.5-Coder-7B-GGUF
Text Generation • 8B • Updated • 526 • 6 -
Qwen/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 316k • 86 -
QuantFactory/Qwen2.5-Coder-1.5B-GGUF
Text Generation • 2B • Updated • 464 • 2 -
QuantFactory/DeepSeek-Coder-V2-Lite-Base-GGUF
Text Generation • 16B • Updated • 295 • 1 -
ibm-granite/granite-34b-code-instruct-8k-GGUF
Text Generation • 34B • Updated • 55 • 5 -
ibm-granite/granite-34b-code-base-8k-GGUF
Text Generation • 34B • Updated • 18 • 3 -
ibm-granite/granite-20b-code-instruct-8k-GGUF
Text Generation • 20B • Updated • 62 • 6 -
ibm-granite/granite-20b-code-base-8k-GGUF
Text Generation • 20B • Updated • 22 • 5 -
QuantFactory/granite-8b-code-instruct-128k-GGUF
Text Generation • 8B • Updated • 197 • 3 -
RichardErkhov/ibm-granite_-_granite-8b-code-base-128k-gguf
8B • Updated • 223 -
ibm-granite/granite-8b-code-instruct-4k-GGUF
Text Generation • 8B • Updated • 11.2k • 13 -
ibm-granite/granite-8b-code-base-4k-GGUF
Text Generation • 8B • Updated • 31 • 2 -
mradermacher/granite-3b-code-instruct-128k-GGUF
3B • Updated • 118 • 1 -
QuantFactory/granite-3b-code-base-128k-GGUF
Text Generation • 3B • Updated • 21 • 2 -
ibm-granite/granite-3b-code-instruct-2k-GGUF
Text Generation • 3B • Updated • 75 • 7 -
ibm-granite/granite-3b-code-base-2k-GGUF
Text Generation • 3B • Updated • 16 • 3