Edge-Quant/granite-4.0-micro-Q4_K_M-GGUF
3B
•
Updated
•
31
2. Mid-Range Devices Llm models
4-8 GB RAM
-
-
Edge-Quant/gemma-3-4b-it-Q4_K_M-GGUF
Image-Text-to-Text • 4B • Updated • 32 -
Edge-Quant/gemma-3n-E2B-it-Q4_K_M-GGUF
Image-Text-to-Text • 4B • Updated • 75 • 1 -
Edge-Quant/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 60 -
Edge-Quant/VibeThinker-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 24 -
Edge-Quant/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 328 -
Edge-Quant/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 17 -
Edge-Quant/Gemmasutra-Mini-2B-v1-Q4_K_M-GGUF
3B • Updated • 73 • 1 -
Edge-Quant/AFM-4.5B-Q4_K_M-GGUF
5B • Updated • 44 -
Edge-Quant/Hunyuan-4B-Instruct-Q4_K_M-GGUF
4B • Updated • 18 -
Edge-Quant/Ministral-3b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 21 -
Edge-Quant/Ministral-3-3B-Reasoning-2512-Q4_K_M-GGUF
3B • Updated • 49 -
Edge-Quant/SmallThinker-3B-Preview-Q4_K_M-GGUF
Text Generation • 3B • Updated • 19 -
Edge-Quant/SmallThinker-4BA0.6B-Instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 8 -
Edge-Quant/SmolLM3-3B-Q4_K_M-GGUF
3B • Updated • 58 -
Edge-Quant/Qwen3-4B-Instruct-2507-Q4_K_M-GGUF
Text Generation • 4B • Updated • 21 -
Edge-Quant/Jan-v1-4B-Q4_K_M-GGUF
Text Generation • 4B • Updated • 21 -
Edge-Quant/sarvam-1-Q4_K_M-GGUF
3B • Updated • 25 -
Edge-Quant/Nanbeige4-3B-Thinking-2511-Q4_K_M-GGUF
Text Generation • 4B • Updated • 23