Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,221

Full-text search

Active filters: llama.cpp

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated 4 days ago • 77.5k • 369

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 9 days ago • 10.5k • 47

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Jan 5 • 47.7k • 136

NexaAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 2 days ago • 456 • 6

TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF

33B • Updated 22 days ago • 5.24k • 5

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated about 20 hours ago • 47.3k • 9

TeichAI/Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill-GGUF

4B • Updated Dec 20, 2025 • 4.1k • 4

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Jan 16 • 44.2k • 59

LiquidAI/LFM2-8B-A1B-GGUF

Text Generation • 8B • Updated Dec 5, 2025 • 4.62k • 88

TeichAI/Qwen3-14B-GPT-5.2-High-Reasoning-Distill-GGUF

15B • Updated Dec 23, 2025 • 3.54k • 7

TeichAI/Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill-GGUF

4B • Updated Dec 24, 2025 • 1.97k • 7

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated 22 days ago • 6.6k • 78

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated about 20 hours ago • 13k • 4

ox-ox/MiniMax-M2.5-GGUF

Text Generation • 229B • Updated 13 days ago • 3.3k • 17

prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX-GGUF

Image-Text-to-Text • 8B • Updated 5 days ago • 1.83k • 3

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated 1 day ago • 5.6k • 3

exdysa/MiniMax-M2.5-REAP-172B-A10B-GGUF-Q4_K_M

Text Generation • 173B • Updated 6 days ago • 403 • 2

nvjob/crack-ru-v2-gguf

12B • Updated Feb 24, 2025 • 223 • 3

LiquidAI/LFM2-700M-GGUF

Text Generation • 0.7B • Updated Dec 5, 2025 • 28.5k • 45

mistralai/Magistral-Small-2507-GGUF

Text Generation • 24B • Updated Jul 25, 2025 • 379 • 13

LiquidAI/LFM2-Audio-1.5B-GGUF

0.3B • Updated Dec 5, 2025 • 1.02k • 28

Avarok/nvidia-nemotron-nano-12b-v2-q4_k_m

12B • Updated Nov 3, 2025 • 47 • 1

prithivMLmods/Qwen3-VisionCaption-2B

Image-Text-to-Text • 2B • Updated Nov 29, 2025 • 40 • 5

TeichAI/Qwen3-8B-DeepSeek-v3.2-Speciale-Distill-GGUF

8B • Updated Dec 10, 2025 • 10.7k • 18

prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v2-GGUF

Image-Text-to-Text • 8B • Updated Dec 15, 2025 • 11.9k • 17

TeichAI/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-GGUF

8B • Updated Dec 17, 2025 • 1.64k • 7

TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill-GGUF

4B • Updated Dec 23, 2025 • 219 • 1

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 141 • 1

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 47 • 1

TeichAI/Qwen3-4B-Instruct-2507-Claude-Opus-3-Distill-GGUF

4B • Updated Dec 26, 2025 • 1.54k • 5