Update README.md
Browse files
README.md
CHANGED
|
@@ -148,10 +148,10 @@ Benchmarking is one of the most important procedures during model acceleration.
|
|
| 148 |
|
| 149 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
| 150 |
|---------------|---|---|---|----|----------|------------|
|
| 151 |
-
| arc_challenge | 57.50 | 59.60 | 61.00 | 60.70 | 60.70 |
|
| 152 |
-
| mmlu | 78.10 | 79.10 | 79.80 | 79.80 | 79.80 |
|
| 153 |
-
| piqa | 81.30 | 81.60 | 81.70 | 81.30 | 81.30 |
|
| 154 |
-
| winogrande | 73.80 | 72.90 | 75.00 | 76.00 | 76.00 |
|
| 155 |
|
| 156 |
|
| 157 |
|
|
|
|
| 148 |
|
| 149 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
| 150 |
|---------------|---|---|---|----|----------|------------|
|
| 151 |
+
| arc_challenge | 57.50 | 59.60 | 61.00 | 60.70 | 60.70 | 49.90 | - |
|
| 152 |
+
| mmlu | 78.10 | 79.10 | 79.80 | 79.80 | 79.80 | 66.40 | - |
|
| 153 |
+
| piqa | 81.30 | 81.60 | 81.70 | 81.30 | 81.30 | 73.30 | - |
|
| 154 |
+
| winogrande | 73.80 | 72.90 | 75.00 | 76.00 | 76.00 | 60.0 | - |
|
| 155 |
|
| 156 |
|
| 157 |
|