Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,188

Full-text search

Active filters: distillation

federicoramos77/Hermes-3-Llama-3.2-3B-mlx-4Bit

Text Generation • 0.5B • Updated Aug 1, 2025 • 8

federicoramos77/Hermes-3-Llama-3.2-3B-mlx-3Bit

Text Generation • 0.4B • Updated Aug 1, 2025 • 10

cgus/Homunculus-abliterated-exl2

Updated Aug 2, 2025 • 2

hamzabouajila/distilled_tunbert

Fill-Mask • 67M • Updated Sep 11, 2025 • 2

PJMixers-Images/lightx2v_Qwen-Image-Lightning-4step-8step-Merge

Text-to-Image • Updated Aug 12, 2025 • 124 • 12

PJMixers-Images/lightx2v_Qwen-Image-Lightning-8steps-V1.0-V1.1

Text-to-Image • Updated Aug 14, 2025 • 16 • 3

xumingtensor/affine-161803699

Text Generation • 24B • Updated Aug 17, 2025 • 2

Sweelol-ai/gemma3-270m-dolly-teacher

Text Classification • 0.4B • Updated Aug 26, 2025 • 2

Sweelol-ai/kd-gemma3-pruned-dolly

Text Generation • 0.4B • Updated Aug 26, 2025 • 3

Sweelol-ai/finetuned-pruned-gemma3-270m-dolly

Text Classification • 0.4B • Updated Aug 26, 2025 • 2

sweelol/gemma3-270m-dolly-teacher

Text Classification • 0.4B • Updated Aug 26, 2025 • 1

sweelol/kd-gemma3-pruned-dolly

Text Generation • 0.4B • Updated Aug 26, 2025 • 2

sweelol/finetuned-pruned-gemma3-270m-dolly

Text Generation • 0.4B • Updated Aug 26, 2025 • 3

jorgedelpozolerida/Llama3-OpenBioLLM-8B-Q8_0-GGUF

8B • Updated Aug 29, 2025 • 10

mradermacher/Qwen3-30B-A3B-Thinking-2507-Deepseek-v3.1-Distill-FP32-GGUF

31B • Updated Aug 30, 2025 • 715 • 4

mradermacher/KafkaLM-15B-GGUF

16B • Updated Aug 31, 2025 • 15 • 1

mradermacher/KafkaLM-15B-i1-GGUF

16B • Updated Dec 23, 2025 • 457 • 1

mradermacher/Homunculus-GGUF

12B • Updated Sep 1, 2025 • 23 • 1

mradermacher/Homunculus-i1-GGUF

12B • Updated Dec 25, 2025 • 61 • 1

lightx2v/Wan2.2-I2V-A14B-Moe-Distill-Lightx2v

Image-to-Video • Updated Oct 17, 2025 • 72

rovnerivan/Qwen3-30B-A3B-Thinking-2507-Deepseek-v3.1-Distill-FP32-Q5_K_S-GGUF

31B • Updated Sep 3, 2025 • 5

mradermacher/DeepSeek-R1-Distill-Llama-8B-Ko-Reasoning-GGUF

8B • Updated Sep 3, 2025 • 155 • 1

groxaxo/Qwen3-30B-A3B-Thinking-2507-Deepseek-v3.1-Distill-INT8-A8W16

8B • Updated Sep 6, 2025 • 3 • 1

mradermacher/OpenBioLLm-70B-GGUF

71B • Updated Sep 7, 2025 • 45

mradermacher/OpenBioLLm-70B-i1-GGUF

71B • Updated Dec 31, 2025 • 18

zary0/faster-whisper-ja-distill

Automatic Speech Recognition • 0.2B • Updated Sep 9, 2025 • 1

mradermacher/KafkaLM-15B-Base-GGUF

16B • Updated Sep 7, 2025 • 6

mradermacher/KafkaLM-15B-Base-i1-GGUF

16B • Updated Dec 31, 2025 • 342

jc2375/Qwen3-30B-A3B-Thinking-2507-Deepseek-v3.1-Distill-FP32-mlx-4Bit

31B • Updated Sep 8, 2025 • 39

mradermacher/WEBGEN-4B-Preview-480B-Double-Distill-FP32-GGUF

4B • Updated Sep 11, 2025 • 12