Update README.md
Browse files
README.md
CHANGED
|
@@ -14,13 +14,12 @@ license: other
|
|
| 14 |
license_name: mrl
|
| 15 |
license_link: https://mistral.ai/licenses/MRL-0.1.md
|
| 16 |
base_model:
|
| 17 |
-
-
|
|
|
|
| 18 |
---
|
| 19 |
# Writer-Large-2411-v2.1
|
| 20 |
|
| 21 |
-
EXL2-Quant
|
| 22 |
-
|
| 23 |
-
Creative-Writing Control-Vectors available here: [gghfez/Writer-Large-2411-v2.1-control-vectors](https://huggingface.co/gghfez/Writer-Large-2411-v2.1-control-vectors)
|
| 24 |
|
| 25 |
## Overview
|
| 26 |
|
|
@@ -34,12 +33,13 @@ This model is built on Mistral-Large-Instruct-2411 and optimized for creative wr
|
|
| 34 |
- Better handling of "group chat" scenarios
|
| 35 |
|
| 36 |
|
|
|
|
| 37 |
<img src="https://files.catbox.moe/hisiua.png" width="400"/>
|
| 38 |
|
| 39 |
## Usage
|
| 40 |
|
| 41 |
### Prompt Template
|
| 42 |
-
**The model
|
| 43 |
If you omit [`SYSTEM_PROMPT] [/SYSTEM_PROMPT]`, the model:
|
| 44 |
- May not follow instructions properly at short contexts
|
| 45 |
- Can become repetitive at longer contexts
|
|
@@ -50,9 +50,6 @@ Example:
|
|
| 50 |
```
|
| 51 |
|
| 52 |
### SillyTavern Integration
|
| 53 |
-
|
| 54 |
-
#### With System Prompt:
|
| 55 |
-
|
| 56 |
Story String:
|
| 57 |
```python
|
| 58 |
[SYSTEM_PROMPT] {{#if system}}{{system}}[/SYSTEM_PROMPT] [INST]
|
|
@@ -65,20 +62,6 @@ Story String:
|
|
| 65 |
{{/if}}{{trim}}[/INST] Understood.</s>
|
| 66 |
```
|
| 67 |
|
| 68 |
-
#### Without System Prompt:
|
| 69 |
-
|
| 70 |
-
Story String:
|
| 71 |
-
```python
|
| 72 |
-
[INST]{{#if system}}{{system}}[/SYSTEM_PROMPT]
|
| 73 |
-
{{/if}}{{#if wiBefore}}{{wiBefore}}
|
| 74 |
-
{{/if}}{{#if description}}{{description}}
|
| 75 |
-
{{/if}}{{#if personality}}{{personality}}
|
| 76 |
-
{{/if}}{{#if scenario}}{{scenario}}
|
| 77 |
-
{{/if}}{{#if wiAfter}}{{wiAfter}}
|
| 78 |
-
{{/if}}{{#if persona}}{{persona}}
|
| 79 |
-
{{/if}}{{trim}}[/INST] Understood.</s>
|
| 80 |
-
```
|
| 81 |
-
|
| 82 |
For response steering, use `[OOC]` commands, e.g.:
|
| 83 |
- `[OOC] Have them interrupted by a loud explosion in a nearby factory`
|
| 84 |
- `[OOC] Have her refuse to sell it and suggest another merchant instead`
|
|
|
|
| 14 |
license_name: mrl
|
| 15 |
license_link: https://mistral.ai/licenses/MRL-0.1.md
|
| 16 |
base_model:
|
| 17 |
+
- gghfez/Writer-Large-2411-v2.1
|
| 18 |
+
library_name: transformers
|
| 19 |
---
|
| 20 |
# Writer-Large-2411-v2.1
|
| 21 |
|
| 22 |
+
EXL2-Quant of [gghfez/Writer-Large-2411-v2.1](https://huggingface.co/gghfez/Writer-Large-2411-v2.1)
|
|
|
|
|
|
|
| 23 |
|
| 24 |
## Overview
|
| 25 |
|
|
|
|
| 33 |
- Better handling of "group chat" scenarios
|
| 34 |
|
| 35 |
|
| 36 |
+
|
| 37 |
<img src="https://files.catbox.moe/hisiua.png" width="400"/>
|
| 38 |
|
| 39 |
## Usage
|
| 40 |
|
| 41 |
### Prompt Template
|
| 42 |
+
**The model requires a system prompt in the Mistral-V7 format.**
|
| 43 |
If you omit [`SYSTEM_PROMPT] [/SYSTEM_PROMPT]`, the model:
|
| 44 |
- May not follow instructions properly at short contexts
|
| 45 |
- Can become repetitive at longer contexts
|
|
|
|
| 50 |
```
|
| 51 |
|
| 52 |
### SillyTavern Integration
|
|
|
|
|
|
|
|
|
|
| 53 |
Story String:
|
| 54 |
```python
|
| 55 |
[SYSTEM_PROMPT] {{#if system}}{{system}}[/SYSTEM_PROMPT] [INST]
|
|
|
|
| 62 |
{{/if}}{{trim}}[/INST] Understood.</s>
|
| 63 |
```
|
| 64 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 65 |
For response steering, use `[OOC]` commands, e.g.:
|
| 66 |
- `[OOC] Have them interrupted by a loud explosion in a nearby factory`
|
| 67 |
- `[OOC] Have her refuse to sell it and suggest another merchant instead`
|