Update README.md
Browse files
README.md
CHANGED
|
@@ -53,11 +53,11 @@ For more details, including benchmark evaluation, hardware requirements, and inf
|
|
| 53 |
| HMMT25 | 27.5 | 7.9 | 15.9 | 38.8 | 10.0 | **55.4** |
|
| 54 |
| ARC-AGI | 9.0 | 8.8 | 30.3 | 13.3 | 4.3 | **41.8** |
|
| 55 |
| ZebraLogic | 83.4 | 52.6 | - | 89.0 | 37.7 | **95.0** |
|
| 56 |
-
|
|
| 57 |
| **Coding** | | | | | | |
|
| 58 |
| LiveCodeBench v6 (25.02-25.05) | 45.2 | 35.8 | 44.6 | 48.9 | 32.9 | **51.8** |
|
| 59 |
| MultiPL-E | 82.2 | 82.7 | **88.5** | 85.7 | 79.3 | 87.9 |
|
| 60 |
-
| Aider | 55.1 | 45.3 | **70.7** | 59.0 | 59.6 | 57.3 |
|
| 61 |
| **Alignment** | | | | | | |
|
| 62 |
| IFEval | 82.3 | 83.9 | 87.4 | **89.8** | 83.2 | 88.7 |
|
| 63 |
| Arena-Hard v2* | 45.6 | 61.9 | 51.5 | 66.1 | 52.0 | **79.2** |
|
|
@@ -78,7 +78,6 @@ For more details, including benchmark evaluation, hardware requirements, and inf
|
|
| 78 |
\#: Results were generated using GPT-4o-20241120, as access to the native function calling API of GPT-4o-0327 was unavailable.
|
| 79 |
|
| 80 |
|
| 81 |
-
|
| 82 |
## Quickstart
|
| 83 |
|
| 84 |
The code of Qwen3-MoE has been in the latest Hugging Face `transformers` and we advise you to use the latest version of `transformers`.
|
|
|
|
| 53 |
| HMMT25 | 27.5 | 7.9 | 15.9 | 38.8 | 10.0 | **55.4** |
|
| 54 |
| ARC-AGI | 9.0 | 8.8 | 30.3 | 13.3 | 4.3 | **41.8** |
|
| 55 |
| ZebraLogic | 83.4 | 52.6 | - | 89.0 | 37.7 | **95.0** |
|
| 56 |
+
| LiveBench 20241125 | 66.9 | 63.7 | 74.6 | **76.4** | 62.5 | 75.4 |
|
| 57 |
| **Coding** | | | | | | |
|
| 58 |
| LiveCodeBench v6 (25.02-25.05) | 45.2 | 35.8 | 44.6 | 48.9 | 32.9 | **51.8** |
|
| 59 |
| MultiPL-E | 82.2 | 82.7 | **88.5** | 85.7 | 79.3 | 87.9 |
|
| 60 |
+
| Aider-Polyglot | 55.1 | 45.3 | **70.7** | 59.0 | 59.6 | 57.3 |
|
| 61 |
| **Alignment** | | | | | | |
|
| 62 |
| IFEval | 82.3 | 83.9 | 87.4 | **89.8** | 83.2 | 88.7 |
|
| 63 |
| Arena-Hard v2* | 45.6 | 61.9 | 51.5 | 66.1 | 52.0 | **79.2** |
|
|
|
|
| 78 |
\#: Results were generated using GPT-4o-20241120, as access to the native function calling API of GPT-4o-0327 was unavailable.
|
| 79 |
|
| 80 |
|
|
|
|
| 81 |
## Quickstart
|
| 82 |
|
| 83 |
The code of Qwen3-MoE has been in the latest Hugging Face `transformers` and we advise you to use the latest version of `transformers`.
|