Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

23,061

Full-text search

Active filters: gguf-my-repo

Cran-May/openbuddy-mistral2-7b-v20.2-32k-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 11

qnixsynapse/gemma-1.1-2b-it-Q4_K_S-GGUF

3B • Updated Apr 6, 2024 • 8

bunnycore/Phigments12-Q6_K-GGUF

3B • Updated Apr 6, 2024 • 7 • 1

Cran-May/SLIDE-v2-Q4_K_S-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 5

Cran-May/SLIDE-v2-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 4

Cran-May/SLIDE-v2-Q2_K-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 5

SourPineapple/EEVE-Korean-Instruct-10.8B-v1.0-Q5_K_M-GGUF

11B • Updated Apr 6, 2024 • 9 • 1

munish0838/Mistral-7B-OpenOrca-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 31 • 2

munish0838/Mistral-7B-OpenOrca-Q8_0-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 6 • 1

m0javad/dolly-v2-12b-Q8_0-GGUF

12B • Updated Apr 6, 2024 • 7

fivetech/gemma-1.1-7b-it-Q2_K-GGUF

9B • Updated Apr 6, 2024 • 11

jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9-Q4_K_M-GGUF

13B • Updated Apr 6, 2024 • 11

NikolayKozloff/csmpt7b-Czech-GGUF

7B • Updated Apr 6, 2024 • 49 • 4

NikolayKozloff/polanka-3b-pretrain-full-v0.4-GGUF

3B • Updated Apr 6, 2024 • 13 • 1

SmartGitiCorp/PersianMind-v1.0-Q8_0-GGUF

Text Generation • 7B • Updated Jun 2, 2024 • 32 • 11

NikolayKozloff/mGPT-1.3B-ossetian-GGUF

2B • Updated Apr 6, 2024 • 18 • 1

NikolayKozloff/mGPT-1.3B-mari-GGUF

2B • Updated Apr 6, 2024 • 24 • 1

NikolayKozloff/mGPT-1.3B-tajik-GGUF

2B • Updated Apr 6, 2024 • 29 • 1

NikolayKozloff/mGPT-1.3B-kirgiz-GGUF

2B • Updated Apr 6, 2024 • 43 • 1

NikolayKozloff/mGPT-1.3B-uzbek-GGUF

2B • Updated Apr 6, 2024 • 22 • 1

NikolayKozloff/mGPT-1.3B-georgian-GGUF

2B • Updated Apr 6, 2024 • 40 • 1

NikolayKozloff/mGPT-1.3B-armenian-GGUF

2B • Updated Apr 6, 2024 • 41 • 2

NikolayKozloff/mGPT-1.3B-chuvash-GGUF

2B • Updated Apr 6, 2024 • 10 • 1

lefromage/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

1B • Updated Apr 6, 2024 • 4

teneriffa/Qwen1.5-32B-Q4_0-GGUF

Text Generation • 33B • Updated Apr 6, 2024 • 15

teneriffa/Qwen1.5-32B-Chat-Q4_0-GGUF

Text Generation • 33B • Updated Apr 6, 2024 • 14

alexcovo/dolphin-2.8-mistral-7b-v02-Q4_0-GGUF

7B • Updated Apr 6, 2024 • 22

xddlol/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 8

xddlol/WestLake-7B-v2-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 6, 2024 • 8

teneriffa/CapyTessBorosYi-Spicyboros-LimaRPv3-34B-Q4_0-GGUF

34B • Updated Apr 6, 2024 • 7