Code writing AI Model Scoring List - July 2024
| Ranking |
|---|
|
|
|
| 4 |
| 5 |
| 6 |
| 7 |
| 8 |
| 9 |
| 10 |
| 11 |
| 12 |
| 13 |
| 14 |
| 15 |
| 16 |
| 17 |
| 18 |
| 19 |
| 20 |
| 21 |
| 22 |
| 23 |
| 24 |
| 25 |
| 26 |
| 27 |
| 28 |
| 29 |
| 30 |
| 31 |
| 32 |
| 33 |
| 34 |
| 35 |
| 36 |
| MODEL NAME | RELEASE DATE | PARAMETERS | Code writing
|
Code writing(ZH)
|
Code writing(EN)
|
Code Competition(ZH)
|
Code Competition(EN)
|
Code Instruct Execution(ZH)
|
Code Instruct Execution(EN)
|
code Q&A(ZH)
|
code Q&A(EN)
|
|---|---|---|---|---|---|---|---|---|---|---|---|
| May 13, 2024 | N/A |
6.9
|
6.9
|
6.8
|
N/A
|
N/A
|
N/A
|
N/A
|
5.9
|
5.8
|
|
| June 21, 2024 | N/A |
6.9
|
6.8
|
7.1
|
N/A
|
N/A
|
N/A
|
N/A
|
5.5
|
5.3
|
|
| May 6, 2024 | 236B |
6.6
|
6.6
|
6.5
|
N/A
|
N/A
|
N/A
|
N/A
|
5.0
|
4.7
|
|
| February 26, 2024 | N/A |
6.5
|
6.4
|
6.5
|
N/A
|
N/A
|
N/A
|
N/A
|
5.0
|
5.1
|
|
| July 18, 2024 | N/A |
6.3
|
6.1
|
6.4
|
N/A
|
N/A
|
N/A
|
N/A
|
5.3
|
5.1
|
|
| January 16, 2024 | N/A |
5.6
|
5.5
|
5.6
|
N/A
|
N/A
|
N/A
|
N/A
|
4.7
|
4.4
|
|
| July 24, 2024 | 123B |
5.5
|
5.3
|
5.7
|
N/A
|
N/A
|
N/A
|
N/A
|
5.1
|
4.8
|
|
| May 13, 2024 | N/A |
5.4
|
5.4
|
5.4
|
N/A
|
N/A
|
N/A
|
N/A
|
4.3
|
4.6
|
|
| June 27, 2024 | 27B |
5.4
|
5.2
|
5.7
|
N/A
|
N/A
|
N/A
|
N/A
|
4.8
|
4.2
|
|
| July 23, 2024 | 70B |
5.3
|
5.0
|
5.6
|
N/A
|
N/A
|
N/A
|
N/A
|
3.9
|
4.5
|
|
| April 28, 2024 | N/A |
5.2
|
5.1
|
5.3
|
N/A
|
N/A
|
N/A
|
N/A
|
4.9
|
4.3
|
|
| April 17, 2024 | N/A |
5.0
|
4.8
|
5.2
|
N/A
|
N/A
|
N/A
|
N/A
|
3.7
|
4.1
|
|
| May 18, 2024 | N/A |
5.0
|
5.2
|
4.8
|
N/A
|
N/A
|
N/A
|
N/A
|
4.3
|
3.0
|
|
| June 15, 2024 | N/A |
5.0
|
4.9
|
5.0
|
N/A
|
N/A
|
N/A
|
N/A
|
2.0
|
1.6
|
|
| April 25, 2024 | 110B |
4.9
|
4.8
|
5.0
|
N/A
|
N/A
|
N/A
|
N/A
|
4.3
|
4.0
|
|
| June 6, 2024 | 72B |
4.9
|
4.8
|
5.0
|
N/A
|
N/A
|
N/A
|
N/A
|
4.1
|
3.3
|
|
| April 26, 2024 | N/A |
4.7
|
4.7
|
4.6
|
N/A
|
N/A
|
N/A
|
N/A
|
4.4
|
3.6
|
|
| May 21, 2024 | N/A |
4.6
|
4.8
|
4.4
|
N/A
|
N/A
|
N/A
|
N/A
|
3.5
|
2.0
|
|
| June 28, 2024 | N/A |
4.5
|
4.4
|
4.6
|
N/A
|
N/A
|
N/A
|
N/A
|
2.5
|
2.1
|
|
| June 4, 2024 | 9B |
4.5
|
4.2
|
4.7
|
N/A
|
N/A
|
N/A
|
N/A
|
2.8
|
3.3
|
|
| May 22, 2024 | N/A |
4.4
|
4.4
|
4.3
|
N/A
|
N/A
|
N/A
|
N/A
|
4.5
|
3.9
|
|
| June 6, 2024 | 7B |
4.4
|
4.4
|
4.4
|
N/A
|
N/A
|
N/A
|
N/A
|
3.0
|
2.7
|
|
| April 17, 2024 | 141B |
4.4
|
4.6
|
4.2
|
N/A
|
N/A
|
N/A
|
N/A
|
3.0
|
2.4
|
|
| May 12, 2024 | 34B |
4.4
|
4.3
|
4.6
|
N/A
|
N/A
|
N/A
|
N/A
|
4.2
|
4.3
|
|
| May 8, 2024 | N/A |
4.4
|
4.2
|
4.5
|
N/A
|
N/A
|
N/A
|
N/A
|
3.0
|
2.9
|
|
| June 27, 2024 | 9B |
4.2
|
3.9
|
4.4
|
N/A
|
N/A
|
N/A
|
N/A
|
3.6
|
3.6
|
|
| May 12, 2024 | 9B |
4.1
|
3.8
|
4.5
|
N/A
|
N/A
|
N/A
|
N/A
|
3.6
|
4.4
|
|
| July 23, 2024 | 8B |
3.9
|
3.7
|
4.1
|
N/A
|
N/A
|
N/A
|
N/A
|
2.6
|
3.4
|
|
| January 11, 2024 | 20B |
3.6
|
3.8
|
3.4
|
N/A
|
N/A
|
N/A
|
N/A
|
2.6
|
1.3
|
|
| July 5, 2024 | 7B |
3.4
|
3.4
|
3.5
|
N/A
|
N/A
|
N/A
|
N/A
|
2.2
|
2.0
|
|
| May 12, 2024 | 6B |
3.4
|
3.1
|
3.7
|
N/A
|
N/A
|
N/A
|
N/A
|
2.7
|
3.0
|
|
| May 28, 2024 | 16B |
3.3
|
3.0
|
3.6
|
N/A
|
N/A
|
N/A
|
N/A
|
2.8
|
3.6
|
|
| March 26, 2024 | 132B |
3.2
|
3.2
|
3.2
|
N/A
|
N/A
|
N/A
|
N/A
|
2.0
|
1.4
|
|
| December 11, 2023 | 47B |
2.6
|
3.1
|
2.2
|
N/A
|
N/A
|
N/A
|
N/A
|
3.0
|
1.9
|
|
| May 22, 2024 | 7B |
2.3
|
2.3
|
2.3
|
N/A
|
N/A
|
N/A
|
N/A
|
2.5
|
2.2
|
|
| May 15, 2024 | 16B |
1.6
|
2.1
|
1.1
|
N/A
|
N/A
|
N/A
|
N/A
|
2.1
|
1.4
|






