Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

llama-cpp

Inference Endpoints

text-generation-inference

Eval Results

Merge

4-bit precision

custom_code

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

24,211

Full-text search

Active filters: llama-cpp

NikolayKozloff/VibeThinker-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated 3 days ago • 131 • 1

YOYO-AI/Qwen3-30B-A3B-YOYO-V5-Q4_K_M-GGUF

Text Generation • 31B • Updated 1 day ago • 81 • 1

ysn-rfd/RealRobot_LLM-Q8_0-GGUF

4B • Updated about 10 hours ago • 11 • 1

Lamapi/next-ocr-Q8_0-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 41 • 1

Lamapi/next-ocr-Q6_K-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 8 • 1

Lamapi/next-ocr-Q5_K_M-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 4 • 1

Lamapi/next-ocr-Q5_K_S-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 3 • 1

Lamapi/next-ocr-Q5_0-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 4 • 1

Lamapi/next-ocr-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 34 • 1

Lamapi/next-ocr-Q4_K_S-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 7 • 1

Lamapi/next-ocr-Q4_0-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 7 • 1

Lamapi/next-ocr-Q3_K_L-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 6 • 1

Lamapi/next-ocr-Q3_K_M-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 9 • 1

Lamapi/next-ocr-Q3_K_S-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 6 • 1

Lamapi/next-ocr-Q2_K-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 4 • 1

Lamapi/next-ocr-IQ3_M-GGUF

Image-Text-to-Text • 8B • Updated 1 day ago • 7 • 1

Lamapi/next-ocr-IQ3_XXS-GGUF

Image-Text-to-Text • 8B • Updated about 24 hours ago • 8 • 1

Lamapi/next-ocr-IQ4_NL-GGUF

Image-Text-to-Text • 8B • Updated about 24 hours ago • 7 • 1

Lamapi/next-ocr-IQ4_XS-GGUF

Image-Text-to-Text • 8B • Updated about 24 hours ago • 7 • 1

ZeroXClem/Qwen3-4B-ChromaticCoder-Q5_0-GGUF

4B • Updated about 19 hours ago • 3 • 1

ZeroXClem/Qwen3-4B-ChromaticCoder-Q6_K-GGUF

4B • Updated about 19 hours ago • 7 • 1

ZeroXClem/Qwen3-1.7B-TardigradePro-Q4_K_M-GGUF

2B • Updated about 18 hours ago • 5 • 1

Novaciano/Llama-3.2_1b_Erotiquant3_Q4_K_M_GGUF

Text Generation • 1B • Updated Dec 25, 2024 • 9 • 1

MrRobotoAI/Loki-v4.3-8b-EROTICA-128K-Q4_K_M-GGUF

8B • Updated May 24 • 791 • 2

Novaciano/Brutal_Sex_RP-3.2-1B-GGUF

1B • Updated about 11 hours ago • 52 • 1

arkii/chatglm2-6b-ggml

Updated Jul 26, 2023 • 6

BUT-FIT/csmpt7b

Text Generation • 7B • Updated May 21 • 322 • 17

pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

1B • Updated Mar 29, 2024 • 98

reach-vb/phi-2-Q2_K-GGUF

Text Generation • 3B • Updated Mar 27, 2024 • 11

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q2_K-GGUF

1B • Updated Jun 19, 2024 • 121