MaziyarPanahi
/

Qwen2.5-32B-Instruct-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions

Qwen2.5-32B-Instruct-GGUF

263 GB

1 contributor

History: 3 commits

MaziyarPanahi's picture

Create README.md (#2)

e361ba8 verified about 1 year ago

.gitattributes

2.55 kB

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.IQ1_M.gguf

7.93 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.IQ1_S.gguf

7.27 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.IQ2_XS.gguf

9.96 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.IQ3_XS.gguf

13.7 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.IQ4_XS.gguf

17.7 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q2_K.gguf

12.3 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q3_K_L.gguf

17.2 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q3_K_M.gguf

15.9 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q3_K_S.gguf

14.4 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q4_K_M.gguf

19.9 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q4_K_S.gguf

18.8 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q5_K_M.gguf

23.3 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q5_K_S.gguf

22.6 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q6_K.gguf

26.9 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
Qwen2.5-32B-Instruct.Q8_0.gguf

34.8 GB
xet

[WIP] Upload folder using huggingface_hub (multi-commit 0e5f87b08e6f3cf3d11271e168d18c7d1666883de0493b5885a0b704523f4a49) (#1) about 1 year ago
README.md

2.95 kB

Create README.md (#2) about 1 year ago