Update small model card
Browse files
README.md
CHANGED
|
@@ -1,52 +1,21 @@
|
|
| 1 |
-
|
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
-
|
| 4 |
|
| 5 |
-
|
|
|
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
**Output** Text only.
|
| 12 |
-
|
| 13 |
-
**Model Architecture** Mistral AI-7B-v0.1 is a transformer model, with the following architecture choices:
|
| 14 |
- Grouped-Query Attention
|
| 15 |
- Sliding-Window Attention
|
| 16 |
- Byte-fallback BPE tokenizer
|
| 17 |
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
**License** Apache 2.0 license.
|
| 23 |
-
|
| 24 |
-
**Research Paper** TODO: Coming soon.
|
| 25 |
-
|
| 26 |
-
**Where to send questions or comments about the model** TODO: How do people send comments?
|
| 27 |
-
|
| 28 |
-
# **Intended Use**
|
| 29 |
-
**Intended Use Cases** Mistral AI-7B-v0.1 is for commercial and research use. It can be adapted for a variety of natural language generation tasks.
|
| 30 |
-
|
| 31 |
-
# **Evaluation Results**
|
| 32 |
-
We report the standard benchmark results for Mistral AI-7B-v0.1. We use a custom evaluation library to produce the results.
|
| 33 |
-
|
| 34 |
-
| Model | Size | hellaswag | winogrande | piqa | boolq | arc_easy | arc_challenge | naturalqs | naturalqs_5shot | triviaqa_5shot | triviaqa | humaneval_pass@1 | mbpp_pass@1 | mmlu | math | gsm8k |
|
| 35 |
-
|-----------------|------|-----------|------------|--------|--------|----------|---------------|-----------|-----------------|----------------|----------|------------------|-------------|--------|--------|--------|
|
| 36 |
-
| Mistral-7B-v0.1 | 7B | 81.19% | 75.53% | 82.92% | 83.52% | 80.01% | 55.38% | 23.96% | 28.92% | 69.88% | 63.22% | 29.88% | 47.86% | 59.99% | 11.94% | 39.35% |
|
| 37 |
-
|
| 38 |
-
**Theme-based grouping**
|
| 39 |
-
- Commonsense Reasoning: 0-shot average of Hellaswag, Winogrande, PIQA, SIQA, OpenbookQA, ARC-Easy, ARC-Challenge, and CommonsenseQA.
|
| 40 |
-
|
| 41 |
-
- World Knowledge: 5-shot average of NaturalQuestions and TriviaQA.
|
| 42 |
-
|
| 43 |
-
- Reading Comprehension: 0-shot average of BoolQ and QuAC.
|
| 44 |
-
|
| 45 |
-
- Math: Average of 8-shot GSM8K with maj@8 and 4-shot MATH with maj@4
|
| 46 |
-
|
| 47 |
-
- Code: Average of 0-shot Humaneval and 3-shot MBPP
|
| 48 |
-
|
| 49 |
-
- Popular aggregated results: 5-shot MMLU, 3-shot BBH, and 3-5-shot AGI Eval (English multiple-choice questions only)
|
| 50 |
-
|
| 51 |
-
# **Ethical Considerations and Limitations**
|
| 52 |
-
TODO: what do we say here?
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
pipeline_tag: text-generation
|
| 4 |
+
---
|
| 5 |
|
| 6 |
+
# Model Card for Mistral-7B-v0.1
|
| 7 |
|
| 8 |
+
The Mistral AI-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters.
|
| 9 |
+
Mistral AI-7B-v0.1 outperforms Llama 2 13B on all benchmarks we tested.
|
| 10 |
|
| 11 |
+
For full details of this model please read our [Release blog post](https://mistral.ai/news/announcing-mistral-7b-v0.1/)
|
| 12 |
|
| 13 |
+
## Model Architecture
|
| 14 |
+
Mistral AI-7B-v0.1 is a transformer model, with the following architecture choices:
|
|
|
|
|
|
|
|
|
|
| 15 |
- Grouped-Query Attention
|
| 16 |
- Sliding-Window Attention
|
| 17 |
- Byte-fallback BPE tokenizer
|
| 18 |
|
| 19 |
+
## Model Developers
|
| 20 |
+
The Mistral AI Team:
|
| 21 |
+
Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|