Upload folder using huggingface_hub
Browse files
KukulStanta-7B-Seamaiiza-7B-v1-slerp-merge.fp16.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:297abe513d044e4ba62d2eb5ed1fdf71534740df5de5003ae4a59fc071662129
|
| 3 |
+
size 14048491360
|
README.md
CHANGED
|
@@ -14,9 +14,10 @@ KukulStanta-7B-Seamaiiza-7B-v1-slerp-merge is a merge of the following models us
|
|
| 14 |
* [Nitral-AI/KukulStanta-7B](https://huggingface.co/Nitral-AI/KukulStanta-7B)
|
| 15 |
* [AlekseiPravdin/Seamaiiza-7B-v1](https://huggingface.co/AlekseiPravdin/Seamaiiza-7B-v1)
|
| 16 |
|
| 17 |
-
## 🧩 Configuration
|
| 18 |
|
| 19 |
-
```
|
|
|
|
| 20 |
- sources:
|
| 21 |
- model: Nitral-AI/KukulStanta-7B
|
| 22 |
layer_range: [0, 31]
|
|
@@ -31,4 +32,5 @@ parameters:
|
|
| 31 |
- filter: mlp
|
| 32 |
value: [1, 0.5, 0.7, 0.3, 0]
|
| 33 |
- value: 0.5
|
| 34 |
-
dtype: float16
|
|
|
|
|
|
| 14 |
* [Nitral-AI/KukulStanta-7B](https://huggingface.co/Nitral-AI/KukulStanta-7B)
|
| 15 |
* [AlekseiPravdin/Seamaiiza-7B-v1](https://huggingface.co/AlekseiPravdin/Seamaiiza-7B-v1)
|
| 16 |
|
| 17 |
+
## 🧩 Merge Configuration
|
| 18 |
|
| 19 |
+
```yaml
|
| 20 |
+
slices:
|
| 21 |
- sources:
|
| 22 |
- model: Nitral-AI/KukulStanta-7B
|
| 23 |
layer_range: [0, 31]
|
|
|
|
| 32 |
- filter: mlp
|
| 33 |
value: [1, 0.5, 0.7, 0.3, 0]
|
| 34 |
- value: 0.5
|
| 35 |
+
dtype: float16
|
| 36 |
+
```
|