PowerInfer
/

SmallThinker-21BA3B-Instruct-GGUF

Text Generation

Model card Files Files and versions

SmallThinker-21BA3B-Instruct-GGUF

345 GB

3 contributors

History: 15 commits

Yixin Song

Update README.md

22cba58 verified 4 months ago

.gitattributes

3.43 kB

Upload folder using huggingface_hub 4 months ago
README.md

6.04 kB

Update README.md 4 months ago
SmallThinker-21B-A3B-Instruct.F16.gguf

43 GB
xet

Upload SmallThinker-21B-A3B-Instruct.F16.gguf with huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.IQ4_NL.gguf

12.3 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.IQ4_XS.gguf

11.7 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.IQ4_XS.imatrix.gguf

11.6 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q3_K.gguf

10.4 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q3_K.imatrix.gguf

10.4 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q3_K_S.gguf

9.43 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q3_K_S.imatrix.gguf

9.43 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_0.gguf

12.2 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q4_0.gguf with huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_0.imatrix.gguf

12.3 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_0.powerinfer.gguf

12.1 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q4_0.powerinfer.gguf with huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_1.gguf

13.6 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q4_1.gguf with huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_1.imatrix.gguf

13.6 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_K.gguf

13.1 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q4_K.gguf with huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_K.imatrix.gguf

13.1 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_K_S.gguf

12.3 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q4_K_S.imatrix.gguf

12.3 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q5_K.gguf

15.3 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q5_K.imatrix.gguf

15.3 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q6_K.gguf

17.7 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q6_K.gguf with huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q6_K.imatrix.gguf

17.7 GB
xet

Upload folder using huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q8_0.gguf

22.9 GB
xet

Upload SmallThinker-21B-A3B-Instruct.Q8_0.gguf with huggingface_hub 4 months ago
SmallThinker-21B-A3B-Instruct.Q8_0.imatrix.gguf

22.9 GB
xet

Upload folder using huggingface_hub 4 months ago
zh-21b-imatrix.dat

81.3 MB
xet

Upload folder using huggingface_hub 4 months ago