EXL2 quants of GLM-4-9B-0414
4.5 bits per weight
6.0 bits per weight
| Model | Size |
|---|---|
| 4.5 bpw | 6.32 GB |
| 6.0 bpw | 7.85 GB |
Model tree for adriabama06/GLM-4-9B-0414-exl2
Base model
zai-org/GLM-4-9B-0414EXL2 quants of GLM-4-9B-0414
4.5 bits per weight
6.0 bits per weight
| Model | Size |
|---|---|
| 4.5 bpw | 6.32 GB |
| 6.0 bpw | 7.85 GB |
Base model
zai-org/GLM-4-9B-0414