Edit Models filters

Model Tree

mistralai/Mistral-Small-24B-Instruct-2501

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

104

Full-text search

Active filters: mistralai/Mistral-Small-24B-Instruct-2501

mlx-community/Mistral-Small-24B-Instruct-2501-4bit

Updated Jan 30, 2025 • 186 • 14

mlx-community/Mistral-Small-24B-Instruct-2501-3bit

Updated Jan 30, 2025 • 47 • 2

mlx-community/Mistral-Small-24B-Instruct-2501-6bit

Updated Jan 30, 2025 • 16

mlx-community/Mistral-Small-24B-Instruct-2501-8bit

Updated Jan 30, 2025 • 29 • 3

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

24B • Updated Jan 30, 2025 • 7 • 2

bartowski/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jan 30, 2025 • 2.43k • 108

lmstudio-community/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jan 30, 2025 • 215 • 32

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

24B • Updated Jan 30, 2025 • 3 • 2

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q3_K_S-GGUF

24B • Updated Jan 30, 2025 • 5 • 1

hasanbasbunar/Mistral-Small-24B-Instruct-2501-Q4_0-GGUF

24B • Updated Jan 30, 2025 • 15 • 2

phate334/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

24B • Updated Jan 30, 2025 • 31

hasanbasbunar/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

24B • Updated Jan 30, 2025 • 8 • 1

Triangle104/Mistral-Small-24B-Instruct-2501-Q4_K_S-GGUF

24B • Updated Jan 30, 2025 • 13

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jun 23, 2025 • 125k • 7

Triangle104/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

24B • Updated Jan 30, 2025 • 11

Triangle104/Mistral-Small-24B-Instruct-2501-Q5_K_S-GGUF

24B • Updated Jan 30, 2025 • 11 • 1

Triangle104/Mistral-Small-24B-Instruct-2501-Q5_K_M-GGUF

24B • Updated Jan 30, 2025 • 9

spmurrayzzz/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

24B • Updated Jan 30, 2025 • 2

Triangle104/Mistral-Small-24B-Instruct-2501-Q6_K-GGUF

24B • Updated Jan 30, 2025 • 12

Triangle104/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

24B • Updated Jan 30, 2025 • 11

moot20/Mistral-Small-24B-Instruct-2501-MLX-4bit

Text Generation • 4B • Updated Jan 31, 2025 • 5

mradermacher/Mistral-Small-24B-Instruct-2501-i1-GGUF

24B • Updated Jul 25, 2025 • 3.27k • 5

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • 24B • Updated Mar 30, 2025 • 53.4k • 25

ddh0/Mistral-Small-24B-Instruct-2501-GGUF

24B • Updated Jan 30, 2025 • 8

RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic

Text Generation • 24B • Updated Oct 29, 2025 • 793 • 13

unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

Text Generation • 24B • Updated Feb 2, 2025 • 20.3k • 18

unsloth/Mistral-Small-24B-Instruct-2501-bnb-4bit

Text Generation • 24B • Updated Feb 2, 2025 • 1.12k • 3

DevQuasar/mistralai.Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Feb 16, 2025 • 86 • 2

unsloth/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jan 30, 2025 • 3.89k • 26

mmnga/Mistral-Small-24B-Instruct-2501-gguf

24B • Updated Jan 31, 2025 • 640