Anthonyg5005
/

L3-8B-Stheno-v3.1-int8-ct2

Text Generation

quantized model

Model card Files Files and versions

Anthonyg5005 commited on Jun 17, 2024

Commit

9907a3b

·

verified ·

1 Parent(s): d269e5a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ base_model: Sao10K/L3-8B-Stheno-v3.1
 ---
 # CTranslate2 int8 version of L3-8B-Stheno-v3.1
-This is a int8_float16 quantization of [L3-8B-Stheno-v3.1](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.1)\
 See more on CTranslate2: [Docs](https://opennmt.net/CTranslate2/index.html) | [Github](https://github.com/OpenNMT/CTranslate2)
 This model was converted to ct2 format using the following commnd:

 ---
 # CTranslate2 int8 version of L3-8B-Stheno-v3.1
+This is a int8_bfloat16 quantization of [L3-8B-Stheno-v3.1](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.1)\
 See more on CTranslate2: [Docs](https://opennmt.net/CTranslate2/index.html) | [Github](https://github.com/OpenNMT/CTranslate2)
 This model was converted to ct2 format using the following commnd: