v000000
/

Qwen2.5-14B-Gutenberg-Instruct-Slerpeno

Text Generation

text-generation-inference

Model card Files Files and versions

v000000 commited on Sep 20, 2024

Commit

aaaacf5

·

verified ·

1 Parent(s): 1dd07a4

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -54,4 +54,6 @@ parameters:
   t:
     - value: [0, 0, 0.3, 0.4, 0.5, 0.6, 0.5, 0.4, 0.3, 0, 0]
 dtype: bfloat16
-```

   t:
     - value: [0, 0, 0.3, 0.4, 0.5, 0.6, 0.5, 0.4, 0.3, 0, 0]
 dtype: bfloat16
+```
+*The idea here is that Gutenberg DPO stays in the output/input 100% while merging smoothly with the base instruct model in the deeper layers to heal loss and increase intelligence.*