littlebird13 commited on
Commit
8a39f5b
·
verified ·
1 Parent(s): bbd8c67

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -53,11 +53,11 @@ For more details, including benchmark evaluation, hardware requirements, and inf
53
  | HMMT25 | 27.5 | 7.9 | 15.9 | 38.8 | 10.0 | **55.4** |
54
  | ARC-AGI | 9.0 | 8.8 | 30.3 | 13.3 | 4.3 | **41.8** |
55
  | ZebraLogic | 83.4 | 52.6 | - | 89.0 | 37.7 | **95.0** |
56
- | LiveBench1125 | 66.9 | 63.7 | 74.6 | **76.4** | 62.5 | 75.4 |
57
  | **Coding** | | | | | | |
58
  | LiveCodeBench v6 (25.02-25.05) | 45.2 | 35.8 | 44.6 | 48.9 | 32.9 | **51.8** |
59
  | MultiPL-E | 82.2 | 82.7 | **88.5** | 85.7 | 79.3 | 87.9 |
60
- | Aider | 55.1 | 45.3 | **70.7** | 59.0 | 59.6 | 57.3 |
61
  | **Alignment** | | | | | | |
62
  | IFEval | 82.3 | 83.9 | 87.4 | **89.8** | 83.2 | 88.7 |
63
  | Arena-Hard v2* | 45.6 | 61.9 | 51.5 | 66.1 | 52.0 | **79.2** |
@@ -78,7 +78,6 @@ For more details, including benchmark evaluation, hardware requirements, and inf
78
  \#: Results were generated using GPT-4o-20241120, as access to the native function calling API of GPT-4o-0327 was unavailable.
79
 
80
 
81
-
82
  ## Quickstart
83
 
84
  The code of Qwen3-MoE has been in the latest Hugging Face `transformers` and we advise you to use the latest version of `transformers`.
 
53
  | HMMT25 | 27.5 | 7.9 | 15.9 | 38.8 | 10.0 | **55.4** |
54
  | ARC-AGI | 9.0 | 8.8 | 30.3 | 13.3 | 4.3 | **41.8** |
55
  | ZebraLogic | 83.4 | 52.6 | - | 89.0 | 37.7 | **95.0** |
56
+ | LiveBench 20241125 | 66.9 | 63.7 | 74.6 | **76.4** | 62.5 | 75.4 |
57
  | **Coding** | | | | | | |
58
  | LiveCodeBench v6 (25.02-25.05) | 45.2 | 35.8 | 44.6 | 48.9 | 32.9 | **51.8** |
59
  | MultiPL-E | 82.2 | 82.7 | **88.5** | 85.7 | 79.3 | 87.9 |
60
+ | Aider-Polyglot | 55.1 | 45.3 | **70.7** | 59.0 | 59.6 | 57.3 |
61
  | **Alignment** | | | | | | |
62
  | IFEval | 82.3 | 83.9 | 87.4 | **89.8** | 83.2 | 88.7 |
63
  | Arena-Hard v2* | 45.6 | 61.9 | 51.5 | 66.1 | 52.0 | **79.2** |
 
78
  \#: Results were generated using GPT-4o-20241120, as access to the native function calling API of GPT-4o-0327 was unavailable.
79
 
80
 
 
81
  ## Quickstart
82
 
83
  The code of Qwen3-MoE has been in the latest Hugging Face `transformers` and we advise you to use the latest version of `transformers`.