-
-
-
-
-
-
Inference Providers
Active filters:
INT4
iSolver-AI/test123-quantized.w4a16
Image-to-Text
•
Updated
•
2
RedHatAI/phi-4-quantized.w4a16
Text Generation
•
3B
•
Updated
•
267
•
4
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text
•
5B
•
Updated
•
1.36k
•
10
RedHatAI/DeepSeek-R1-quantized.w4a16
Text Generation
•
104B
•
Updated
•
5
•
7
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text
•
20B
•
Updated
•
198k
•
12
RedHatAI/Qwen3-4B-quantized.w4a16
Text Generation
•
1B
•
Updated
•
3.42k
•
4
RedHatAI/Qwen3-1.7B-quantized.w4a16
Text Generation
•
0.8B
•
Updated
•
79
•
3
RedHatAI/Qwen3-0.6B-quantized.w4a16
Text Generation
•
0.4B
•
Updated
•
135
RedHatAI/Qwen3-32B-quantized.w4a16
Text Generation
•
6B
•
Updated
•
1.25k
•
11
RedHatAI/Qwen3-14B-quantized.w4a16
Text Generation
•
3B
•
Updated
•
378
RedHatAI/Qwen3-8B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
6.24k
•
3
WaveCut/PixelWave_FLUX.1-schnell_04_SVDQuant-int4
Text-to-Image
•
Updated
•
91
•
1
RedHatAI/Qwen3-30B-A3B-quantized.w4a16
Text Generation
•
5B
•
Updated
•
1.36k
•
5
RedHatAI/DeepSeek-R1-0528-quantized.w4a16
Text Generation
•
104B
•
Updated
•
187
•
12
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16
Image-Text-to-Text
•
59B
•
Updated
•
206
•
1
RedHatAI/Kimi-K2-Instruct-quantized.w4a16
Text Generation
•
146B
•
Updated
•
378
•
12
RedHatAI/Devstral-Small-2507-quantized.w4a16
Text Generation
•
4B
•
Updated
•
28
•
1
ChibuUkachi/Qwen3-4B-Instruct-2507.w4a16
Text Generation
•
1B
•
Updated
•
649
inference-optimization/Qwen3-4B-Thinking-2507.w4a16
Text Generation
•
1B
•
Updated
•
73
inference-optimization/Qwen3-4B-Instruct-2507.w4a16
Text Generation
•
1B
•
Updated
•
9
inference-optimization/Qwen3-30B-A3B-Thinking-2507.w4a16
Text Generation
•
5B
•
Updated
•
8
RedHatAI/Qwen3-30B-A3B-Instruct-2507.w4a16
Text Generation
•
5B
•
Updated
•
67
RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
37
RedHatAI/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
Text Generation
•
Updated
•
78
EmbeddedLLM/Qwen3-VL-30B-A3B-Instruct.w4a16
Text Generation
•
5B
•
Updated
•
59
EmbeddedLLM/Qwen3-VL-30B-A3B-Thinking.w4a16
Text Generation
•
5B
•
Updated
•
8