Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qT3qm7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
17b6d53
T3qT3qm7-7B-GGUF
38.8 GB
1 contributor
History:
11 commits
MaziyarPanahi
057a9a7cae866ddeb1886fbb58c3416fbf9b7933d18c7f829a943a7ed9540e97
17b6d53
verified
over 1 year ago
.gitattributes
2.12 kB
057a9a7cae866ddeb1886fbb58c3416fbf9b7933d18c7f829a943a7ed9540e97
over 1 year ago
T3qT3qm7-7B.IQ3_XS.gguf
3.02 GB
xet
4cb6b987a78ad0f7d4dc23e7319bfb8cf5d1c495abb5622a94de08bea664254e
over 1 year ago
T3qT3qm7-7B.IQ4_XS.gguf
3.94 GB
xet
62f17f21210cb7ee1fd556d94402889ab9439a8dd55ff788e856513bec254792
over 1 year ago
T3qT3qm7-7B.Q2_K.gguf
Safe
2.72 GB
xet
7ed977bf7856da6187b3d141d1b05f9ad30784029ee435fcab9d0ec2a1515292
over 1 year ago
T3qT3qm7-7B.Q3_K_L.gguf
3.82 GB
xet
e15fea4a89eeb6e8fca58464df1f0a4faf73ad6cbcd03eb73b155b64f36af4e3
over 1 year ago
T3qT3qm7-7B.Q3_K_M.gguf
3.52 GB
xet
2e140139e1f19ba8892c9dd06d386c559df591592cd844a9ba56cad6ecf59704
over 1 year ago
T3qT3qm7-7B.Q3_K_S.gguf
3.16 GB
xet
eb5e37755c7e8db159f32d1b25ff4d661aa0a8f36501212d74cbe7fe8e528233
over 1 year ago
T3qT3qm7-7B.Q4_K_M.gguf
4.37 GB
xet
95f5eccbf549b805ce0bd328f01898deb2f676d96c1d6524ddd64ae52a6be407
over 1 year ago
T3qT3qm7-7B.Q4_K_S.gguf
4.14 GB
xet
b84fdd94d0c457873aa9e86d735cc225c6f0a26da9d6bd77f911c5a94d96105b
over 1 year ago
T3qT3qm7-7B.Q5_K_M.gguf
5.13 GB
xet
3f6d2fdfd416528076da10aeecc0cfce12a56ce454fffe422f4a7baf044f2dd1
over 1 year ago
T3qT3qm7-7B.Q5_K_S.gguf
5 GB
xet
057a9a7cae866ddeb1886fbb58c3416fbf9b7933d18c7f829a943a7ed9540e97
over 1 year ago
