Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
AlloyingotneoyExperiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
42a34a0
AlloyingotneoyExperiment28-7B-GGUF
38.8 GB
1 contributor
History:
11 commits
MaziyarPanahi
8f15c9e73de6a6746c51c159f88b0d18aac9d8811a2da102f89f355d8d8cb3ea
42a34a0
verified
over 1 year ago
.gitattributes
2.3 kB
8f15c9e73de6a6746c51c159f88b0d18aac9d8811a2da102f89f355d8d8cb3ea
over 1 year ago
AlloyingotneoyExperiment28-7B.IQ3_XS.gguf
3.02 GB
xet
cd65cd4263f02bb36c9699376f7fa62696e5a0062db457c1287a983d335bcd91
over 1 year ago
AlloyingotneoyExperiment28-7B.IQ4_XS.gguf
3.94 GB
xet
6f88ea4df689c08096cb71cfc17abd0ec2abd5c4e4403a8352e87db70b661544
over 1 year ago
AlloyingotneoyExperiment28-7B.Q2_K.gguf
2.72 GB
xet
02a64846b7022eeabbf84870d09d2722512d1de9e74e1574543753c6da5785b0
over 1 year ago
AlloyingotneoyExperiment28-7B.Q3_K_L.gguf
3.82 GB
xet
c9d4df212b8e58667d34a31db63bbeb77daffbf651a4faf0d85cc06616313b06
over 1 year ago
AlloyingotneoyExperiment28-7B.Q3_K_M.gguf
3.52 GB
xet
51ccc1749c46d72f9fb29901cf7961ea6ec44b598060dab27e97042b32ca2ab6
over 1 year ago
AlloyingotneoyExperiment28-7B.Q3_K_S.gguf
Safe
3.16 GB
xet
e40cb1ed3679a4759ae07feed1f935ba9dbd3cda1d500fd22ec09315ceb4e95c
over 1 year ago
AlloyingotneoyExperiment28-7B.Q4_K_M.gguf
Safe
4.37 GB
xet
05690b59617e43a0a3e0723f0bb0cbf0b35ab48706d49bdee563baf2942fd40a
over 1 year ago
AlloyingotneoyExperiment28-7B.Q4_K_S.gguf
Safe
4.14 GB
xet
dc5749bd4caff537176d96dba59affa76f0ce6e67a78ef3126c7275748e0e982
over 1 year ago
AlloyingotneoyExperiment28-7B.Q5_K_M.gguf
Safe
5.13 GB
xet
110197ce0f1aa9353338fe35c31e752b7c65b944050ae64ae3f266a69d17f67f
over 1 year ago
AlloyingotneoyExperiment28-7B.Q5_K_S.gguf
Safe
5 GB
xet
8f15c9e73de6a6746c51c159f88b0d18aac9d8811a2da102f89f355d8d8cb3ea
over 1 year ago
