Update README.md
Browse files
README.md
CHANGED
|
@@ -48,8 +48,8 @@ Anyway, A2 (The iteration that is on HF and labeled as A) faired a bit better bu
|
|
| 48 |
|
| 49 |
## Model Vibes
|
| 50 |
|
| 51 |
-
I'm writing vibes from my testing
|
| 52 |
-
Plus, it's aspirations to new model mergers
|
| 53 |
For my usage **I actually do not RP.** I love to theory-craft and write scenarios and game events (possibly due to my background but I digress). So take it from that POV:
|
| 54 |
|
| 55 |
1. Tends to write wikipedia like content when asking for idea crafting. It doesn't like giving point forms.
|
|
@@ -58,6 +58,7 @@ For my usage **I actually do not RP.** I love to theory-craft and write scenario
|
|
| 58 |
4. This model like to be more "direct" and pays more attention to the prompt.
|
| 59 |
5. It is able to do dialogue generation (Likely due to wayfarer playing a part in it). But I prefer CursedMagicalGirl or MagicalGirl-2 over this.
|
| 60 |
6. Model should be able to do furry elements well, but I haven't tested it.
|
|
|
|
| 61 |
|
| 62 |
## Prompting
|
| 63 |
|
|
@@ -65,10 +66,34 @@ ChatML seems to work which is what I typically use.
|
|
| 65 |
|
| 66 |
My standard sampler settings are as follows (finally and yes, it's more or less standarized)
|
| 67 |
```
|
| 68 |
-
Temperature: 1.4
|
| 69 |
Min P: 0.03
|
| 70 |
```
|
| 71 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
## Merge Details
|
| 73 |
### Merge Method
|
| 74 |
|
|
|
|
| 48 |
|
| 49 |
## Model Vibes
|
| 50 |
|
| 51 |
+
I'm writing vibes from my testing. Trying to be a bit more transparent on some of my models since I'm sure some that use on featherless would appreciate the added transparency.
|
| 52 |
+
Plus, it's aspirations to new model mergers on what to look out for their own merges.
|
| 53 |
For my usage **I actually do not RP.** I love to theory-craft and write scenarios and game events (possibly due to my background but I digress). So take it from that POV:
|
| 54 |
|
| 55 |
1. Tends to write wikipedia like content when asking for idea crafting. It doesn't like giving point forms.
|
|
|
|
| 58 |
4. This model like to be more "direct" and pays more attention to the prompt.
|
| 59 |
5. It is able to do dialogue generation (Likely due to wayfarer playing a part in it). But I prefer CursedMagicalGirl or MagicalGirl-2 over this.
|
| 60 |
6. Model should be able to do furry elements well, but I haven't tested it.
|
| 61 |
+
7. Base model should make it uncensored. But I think it might be a tad too horny.
|
| 62 |
|
| 63 |
## Prompting
|
| 64 |
|
|
|
|
| 66 |
|
| 67 |
My standard sampler settings are as follows (finally and yes, it's more or less standarized)
|
| 68 |
```
|
| 69 |
+
Temperature: 1.4/1.2
|
| 70 |
Min P: 0.03
|
| 71 |
```
|
| 72 |
|
| 73 |
+
## How 2 Model Merge
|
| 74 |
+
|
| 75 |
+
I'm considering writing an article for this so I'm jotting my notes down in public.
|
| 76 |
+
|
| 77 |
+
### On Selection...
|
| 78 |
+
|
| 79 |
+
In general and "Fun fact". I do not have a rhyme or reason for merging. The reason why I call model merging "Rock smashing" is because it's like one sometimes. You bang 2 different rocks and you get another different rock. You could do all the fancy science nonsense but I personally not a fan of those.
|
| 80 |
+
|
| 81 |
+
Though I think there should be a few points to be made:
|
| 82 |
+
|
| 83 |
+
1. You should probably pre-test select models and read their model description.
|
| 84 |
+
2. Benchmarks can only get you that far before you realize that "there is no perfect benchmark in the world, and any and all benchmarks can be cheated."
|
| 85 |
+
|
| 86 |
+
I'll add more when I can think of them.
|
| 87 |
+
|
| 88 |
+
### On Testing models
|
| 89 |
+
|
| 90 |
+
Due to 2, there is also no standard way to test models. Of course you should be able to tell if the model is behaving like a schizo.
|
| 91 |
+
|
| 92 |
+
1. Test with what you have. *Your own chat logs is a useful way to tell what is good and what is bad*
|
| 93 |
+
2. Write down what you observe compared to other models. (See section on model vibes above).
|
| 94 |
+
In a way, they help inform you what your next model can do better or you want out of a model.
|
| 95 |
+
(i.e. I'm currently considering merging magicalgirl with this model and see if I can get the best out of both worlds)
|
| 96 |
+
|
| 97 |
## Merge Details
|
| 98 |
### Merge Method
|
| 99 |
|