OddTheGreat commited on
Commit
909e64b
·
verified ·
1 Parent(s): 8e323e7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -49
README.md CHANGED
@@ -8,53 +8,28 @@ library_name: transformers
8
  tags:
9
  - mergekit
10
  - merge
11
-
 
 
 
 
12
  ---
13
- # merge
14
-
15
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
-
17
- ## Merge Details
18
- ### Merge Method
19
-
20
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [OddTheGreat/Machina_24B.V2](https://huggingface.co/OddTheGreat/Machina_24B.V2) as a base.
21
-
22
- ### Models Merged
23
-
24
- The following models were included in the merge:
25
- * [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
26
- * [ReadyArt/Forgotten-Safeword-24B](https://huggingface.co/ReadyArt/Forgotten-Safeword-24B)
27
- * [TheDrummer/Cydonia-24B-v2](https://huggingface.co/TheDrummer/Cydonia-24B-v2)
28
-
29
- ### Configuration
30
-
31
- The following YAML configuration was used to produce this model:
32
-
33
- ```yaml
34
- models:
35
- - model: OddTheGreat/Machina_24B.V2
36
- parameters:
37
- density: 0.9
38
- weight: 0.9
39
- - model: TheDrummer/Cydonia-24B-v2
40
- parameters:
41
- density: 0.3
42
- weight: 0.3
43
- - model: ReadyArt/Forgotten-Safeword-24B
44
- parameters:
45
- density: 0.3
46
- weight: 0.3
47
- - model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
48
- parameters:
49
- density: 0.3
50
- weight: 0.3
51
-
52
- merge_method: ties
53
- base_model: OddTheGreat/Machina_24B.V2
54
- parameters:
55
- normalize: false
56
- int8_mask: true
57
- dtype: float16
58
- tokenizer:
59
- source: union
60
- ```
 
8
  tags:
9
  - mergekit
10
  - merge
11
+ - roleplay
12
+ - creative
13
+ language:
14
+ - en
15
+ - ru
16
  ---
17
+ This is a merge of pre-trained language models.
18
+
19
+ This merge goal is to enrich language, RP and ERP capabilities of Machina model. If you liked one, try another.
20
+
21
+ Still has neutral or negative bias, sometimes overreacts (in a good way), have interesting patterns when used as narrator, is creative and rich-languaged.
22
+
23
+ In ERP model behaves good, it can understand hints and teasing, while not going too horny fast.
24
+
25
+ Russian language still here, no problmes spotted.
26
+
27
+ Model was tested on russian and on english with ~600 responses, was stable and good at following instructions, but maybe i'm just very lucky.
28
+
29
+ With char cards that have first message on russian, but whole description on english, model able to answer on desired language, moreso, seems it have less problems with it, than machina..
30
+
31
+ With full ru cards model performs without issues.
32
+
33
+ Tested on T1.01 ChatML
34
+
35
+ I reccomend to use sphiratrioth666/SillyTavern-Presets-Sphiratrioth, for me it works very good with minor adjustments.