Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

334

Full-text search

Active filters: granite-4.0

ibm-granite/granite-4.0-1b-base

Text Generation • 2B • Updated Oct 23 • 173 • 27

ibm-granite/granite-4.0-350m-base

Text Generation • 0.4B • Updated Oct 23 • 2.34k • 25

mradermacher/granite-4.0-h-small-i1-GGUF

32B • Updated 19 days ago • 1.92k

cyankiwi/granite-4.0-h-micro-AWQ-4bit

Text Generation • 0.9B • Updated Oct 8 • 83

cyankiwi/granite-4.0-h-micro-AWQ-8bit

Text Generation • 1B • Updated Oct 8 • 187

Mungert/granite-4.0-h-small-GGUF

32B • Updated Oct 10 • 452

NexVeridian/granite-4.0-micro-5bit

Text Generation • 0.6B • Updated Oct 28 • 11

NexVeridian/granite-4.0-micro-6bit

Text Generation • 0.7B • Updated Oct 28 • 7

NexVeridian/granite-4.0-micro-8bit

Text Generation • 1.0B • Updated Oct 28 • 10

NexVeridian/granite-4.0-h-micro-3bit

Text Generation • 0.4B • Updated Oct 13 • 7

NexVeridian/granite-4.0-h-micro-4bit

Text Generation • 0.5B • Updated Oct 28 • 7

NexVeridian/granite-4.0-h-micro-5bit

Text Generation • 0.6B • Updated Oct 28 • 6

NexVeridian/granite-4.0-h-micro-6bit

Text Generation • 0.7B • Updated Oct 28 • 7

NexVeridian/granite-4.0-h-micro-8bit

Text Generation • 0.9B • Updated Oct 28 • 19

cyankiwi/granite-4.0-h-tiny-AWQ-4bit

Text Generation • 2B • Updated Oct 13 • 236 • 1

cyankiwi/granite-4.0-h-tiny-AWQ-8bit

Text Generation • 3B • Updated Oct 13 • 56

cyankiwi/granite-4.0-h-small-AWQ-4bit

Text Generation • 10B • Updated Oct 13 • 163

cyankiwi/granite-4.0-h-small-AWQ-8bit

Text Generation • 13B • Updated Oct 13 • 81

NexVeridian/granite-4.0-h-tiny-3bit

Text Generation • 0.9B • Updated Oct 28 • 9

NexVeridian/granite-4.0-h-tiny-4bit

Text Generation • 1B • Updated Oct 28 • 17

NexVeridian/granite-4.0-h-tiny-5bit

Text Generation • 1B • Updated Oct 28 • 12

NexVeridian/granite-4.0-h-tiny-6bit

Text Generation • 7B • Updated Oct 28 • 9

NexVeridian/granite-4.0-h-tiny-8bit

Text Generation • 7B • Updated Oct 28 • 28

NexVeridian/granite-4.0-h-small-3bit

Text Generation • 32B • Updated Oct 28 • 15

NexVeridian/granite-4.0-h-small-4bit

Text Generation • 32B • Updated Oct 28 • 11

NexVeridian/granite-4.0-h-small-5bit

Text Generation • 32B • Updated Oct 28 • 10

NexVeridian/granite-4.0-h-small-6bit

Text Generation • 32B • Updated Oct 28 • 11

NexVeridian/granite-4.0-h-small-8bit

Text Generation • 32B • Updated Oct 28 • 21

Mungert/granite-4.0-micro-GGUF

3B • Updated Oct 21 • 146

Mungert/granite-4.0-h-tiny-GGUF

7B • Updated Oct 21 • 515