quazim commited on
Commit
17be3e0
·
verified ·
1 Parent(s): 2c5cb9a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -148,10 +148,10 @@ Benchmarking is one of the most important procedures during model acceleration.
148
 
149
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
150
  |---------------|---|---|---|----|----------|------------|
151
- | arc_challenge | 55.00 | 54.70 | 56.30 | 56.20 | 56.20 | 55.00 | - |
152
- | mmlu | 65.40 | 65.60 | 66.70 | 66.90 | 66.90 | 65.40 | - |
153
- | piqa | 80.00 | 81.10 | 80.80 | 80.80 | 80.80 | 80.00 | - |
154
- | winogrande | 74.20 | 74.30 | 75.10 | 75.10 | 75.10 | 74.20 | - |
155
 
156
 
157
 
 
148
 
149
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
150
  |---------------|---|---|---|----|----------|------------|
151
+ | arc_challenge | 55.00 | 54.70 | 56.30 | 56.20 | 56.20 | 50.50 | - |
152
+ | mmlu | 65.40 | 65.60 | 66.70 | 66.90 | 66.90 | 58.40 | - |
153
+ | piqa | 80.00 | 81.10 | 80.80 | 80.80 | 80.80 | 76.0 | - |
154
+ | winogrande | 74.20 | 74.30 | 75.10 | 75.10 | 75.10 | 66.80 | - |
155
 
156
 
157