Hugging Face's logo

OpenLLM-Ro
/
RoMistral-7b-Instruct-2024-05-17

Text Generation
Transformers
Safetensors
Romanian
mistral
conversational
Eval Results
text-generation-inference
Model card Files
xet
Community
2
mihaimasala commited on
Commit
497d8c9
·
verified ·
1 Parent(s): 9f8acc0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -4
README.md CHANGED
@@ -80,10 +80,20 @@ print(tokenizer.decode(outputs[0]))
80
 
81
  ## MT-Bench
82
 
83
- | Model | Average | 1st turn | 2nd turn |
84
- |--------------------|:--------:|:--------:|:--------:|
85
- | Mistral-7B-Instruct-v0.2 | 4.83 | 5.09 | **4.58** |
86
- | *RoMistral-7b-Instruct*| ***4.91***|***5.67***| *4.16* |
 
 
 
 
 
 
 
 
 
 
87
 
88
 
89
 
 
80
 
81
  ## MT-Bench
82
 
83
+ | Model | Average | 1st turn | 2nd turn | Answers in Ro |
84
+ |--------------------|:--------:|:--------:|:--------:| :--------:|
85
+ | Mistral-7B-Instruct-v0.2 | 4.83 | 5.09 | **4.58** | 154 / 160|
86
+ | *RoMistral-7b-Instruct*| ***4.91***|***5.67***| *4.16* | ***160 / 160***|
87
+
88
+
89
+ ## RoCulturaBench
90
+
91
+ | Model | Score | Answers in Ro|
92
+ |--------------------|:--------:|:--------:|
93
+ | Mistral-7B-Instruct-v0.2 | **3.75** | 99 / 100 |
94
+ |*RoMistral-7b-Instruct*| *3.17*| ***100 / 100*** |
95
+
96
+
97
 
98
 
99