TheBloke
/

wizard-vicuna-13B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

TheBloke commited on May 4, 2023

Commit

3a66857

·

1 Parent(s): c18696c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -27,7 +27,7 @@ Open the text-generation-webui UI as normal.
 3. Click **Download**.
 4. Wait until it says it's finished downloading.
 5. Click the **Refresh** icon next to **Model** in the top left.
-6. In the **Model drop-down**: choose the model you just downloaded,`wizard-vicuna-13B-GPTQ`.
 7. If you see an error in the bottom right, ignore it - it's temporary.
 8. Fill out the `GPTQ parameters` on the right: `Bits = 4`, `Groupsize = 128`, `model_type = Llama`
 9. Click **Save settings for this model** in the top right.

 3. Click **Download**.
 4. Wait until it says it's finished downloading.
 5. Click the **Refresh** icon next to **Model** in the top left.
+6. In the **Model drop-down**: choose the model you just downloaded, `wizard-vicuna-13B-GPTQ`.
 7. If you see an error in the bottom right, ignore it - it's temporary.
 8. Fill out the `GPTQ parameters` on the right: `Bits = 4`, `Groupsize = 128`, `model_type = Llama`
 9. Click **Save settings for this model** in the top right.