Downloads last month
6,500
GGUF
Model size
12B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Lewdiculous/Captain-Eris_Violet-V0.420-12B-GGUF-ARM-Imatrix

Quantized
(9)
this model

Space using Lewdiculous/Captain-Eris_Violet-V0.420-12B-GGUF-ARM-Imatrix 1

Collection including Lewdiculous/Captain-Eris_Violet-V0.420-12B-GGUF-ARM-Imatrix