Update README.md
Browse files
README.md
CHANGED
|
@@ -148,10 +148,10 @@ Benchmarking is one of the most important procedures during model acceleration.
|
|
| 148 |
|
| 149 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
| 150 |
|---------------|---|---|---|----|----------|------------|
|
| 151 |
-
| arc_challenge | 55.00 | 54.70 | 56.30 | 56.20 | 56.20 |
|
| 152 |
-
| mmlu | 65.40 | 65.60 | 66.70 | 66.90 | 66.90 |
|
| 153 |
-
| piqa | 80.00 | 81.10 | 80.80 | 80.80 | 80.80 |
|
| 154 |
-
| winogrande | 74.20 | 74.30 | 75.10 | 75.10 | 75.10 |
|
| 155 |
|
| 156 |
|
| 157 |
|
|
|
|
| 148 |
|
| 149 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
| 150 |
|---------------|---|---|---|----|----------|------------|
|
| 151 |
+
| arc_challenge | 55.00 | 54.70 | 56.30 | 56.20 | 56.20 | 50.50 | - |
|
| 152 |
+
| mmlu | 65.40 | 65.60 | 66.70 | 66.90 | 66.90 | 58.40 | - |
|
| 153 |
+
| piqa | 80.00 | 81.10 | 80.80 | 80.80 | 80.80 | 76.0 | - |
|
| 154 |
+
| winogrande | 74.20 | 74.30 | 75.10 | 75.10 | 75.10 | 66.80 | - |
|
| 155 |
|
| 156 |
|
| 157 |
|