Code writing AI Model Scoring List - September 2024
| Ranking |
|---|
|
|
|
| 4 |
| 5 |
| 6 |
| 7 |
| 8 |
| 9 |
| 10 |
| 11 |
| 12 |
| 13 |
| 14 |
| 15 |
| 16 |
| 17 |
| 18 |
| 19 |
| 20 |
| 21 |
| 22 |
| 23 |
| 24 |
| 25 |
| 26 |
| 27 |
| 28 |
| 29 |
| 30 |
| MODEL NAME | RELEASE DATE | PARAMETERS | Code writing
|
Code writing(ZH)
|
Code writing(EN)
|
Code Competition(ZH)
|
Code Competition(EN)
|
Code Instruct Execution(ZH)
|
Code Instruct Execution(EN)
|
code Q&A(ZH)
|
code Q&A(EN)
|
|---|---|---|---|---|---|---|---|---|---|---|---|
| September 19, 2024 | 72B |
7.4
|
7.5
|
7.3
|
N/A
|
N/A
|
N/A
|
N/A
|
6.2
|
6.3
|
|
| September 5, 2024 | 236B |
7.2
|
7.3
|
7.1
|
N/A
|
N/A
|
N/A
|
N/A
|
6.4
|
6.5
|
|
| June 21, 2024 | N/A |
7.0
|
7.1
|
6.9
|
N/A
|
N/A
|
N/A
|
N/A
|
5.6
|
5.9
|
|
| May 13, 2024 | N/A |
7.0
|
7.1
|
7.0
|
N/A
|
N/A
|
N/A
|
N/A
|
5.8
|
6.1
|
|
| August 6, 2024 | N/A |
6.9
|
6.9
|
6.8
|
N/A
|
N/A
|
N/A
|
N/A
|
5.4
|
5.2
|
|
| August 30, 2024 | N/A |
6.8
|
6.8
|
6.9
|
N/A
|
N/A
|
N/A
|
N/A
|
6.1
|
5.7
|
|
| July 24, 2024 | 123B |
6.7
|
6.6
|
6.8
|
N/A
|
N/A
|
N/A
|
N/A
|
5.7
|
6.0
|
|
| July 18, 2024 | N/A |
6.4
|
6.6
|
6.3
|
N/A
|
N/A
|
N/A
|
N/A
|
5.5
|
5.3
|
|
| October 9, 2024 | N/A |
6.3
|
6.5
|
6.1
|
N/A
|
N/A
|
N/A
|
N/A
|
5.0
|
5.8
|
|
| July 4, 2024 | N/A |
6.2
|
6.3
|
6.1
|
N/A
|
N/A
|
N/A
|
N/A
|
6.1
|
6.4
|
|
| August 28, 2024 | N/A |
6.2
|
6.5
|
5.9
|
N/A
|
N/A
|
N/A
|
N/A
|
3.6
|
4.9
|
|
| September 19, 2024 | 7B |
5.9
|
5.7
|
6.1
|
N/A
|
N/A
|
N/A
|
N/A
|
5.0
|
5.1
|
|
| September 24, 2024 | N/A |
5.8
|
6.3
|
5.4
|
N/A
|
N/A
|
N/A
|
N/A
|
5.5
|
5.9
|
|
| May 13, 2024 | N/A |
5.7
|
5.8
|
5.6
|
N/A
|
N/A
|
N/A
|
N/A
|
4.5
|
4.7
|
|
| July 23, 2024 | 70B |
5.7
|
5.6
|
5.7
|
N/A
|
N/A
|
N/A
|
N/A
|
4.9
|
4.4
|
|
| July 23, 2024 | 70B |
5.6
|
5.3
|
5.9
|
N/A
|
N/A
|
N/A
|
N/A
|
4.4
|
3.8
|
|
| May 21, 2024 | N/A |
5.5
|
5.6
|
5.4
|
N/A
|
N/A
|
N/A
|
N/A
|
5.7
|
5.5
|
|
| June 27, 2024 | 27B |
5.5
|
5.5
|
5.4
|
N/A
|
N/A
|
N/A
|
N/A
|
4.9
|
4.9
|
|
| September 1, 2024 | N/A |
5.2
|
5.3
|
5.1
|
N/A
|
N/A
|
N/A
|
N/A
|
4.6
|
4.9
|
|
| April 17, 2024 | N/A |
5.1
|
5.1
|
5.0
|
N/A
|
N/A
|
N/A
|
N/A
|
4.2
|
4.4
|
|
| September 17, 2024 | 22B |
5.0
|
5.0
|
4.9
|
N/A
|
N/A
|
N/A
|
N/A
|
4.7
|
4.5
|
|
| June 4, 2024 | 9B |
4.4
|
4.4
|
4.4
|
N/A
|
N/A
|
N/A
|
N/A
|
3.5
|
3.6
|
|
| June 27, 2024 | 9B |
4.3
|
4.5
|
4.2
|
N/A
|
N/A
|
N/A
|
N/A
|
3.6
|
4.0
|
|
| May 12, 2024 | 9B |
4.2
|
3.8
|
4.5
|
N/A
|
N/A
|
N/A
|
N/A
|
4.3
|
3.9
|
|
| May 22, 2024 | N/A |
4.1
|
4.1
|
4.0
|
N/A
|
N/A
|
N/A
|
N/A
|
4.1
|
4.6
|
|
| July 18, 2024 | 12B |
4.1
|
3.5
|
4.6
|
N/A
|
N/A
|
N/A
|
N/A
|
4.6
|
3.5
|
|
| July 23, 2024 | 8B |
4.0
|
3.7
|
4.2
|
N/A
|
N/A
|
N/A
|
N/A
|
4.0
|
3.4
|
|
| July 5, 2024 | 7B |
3.5
|
3.5
|
3.4
|
N/A
|
N/A
|
N/A
|
N/A
|
2.2
|
2.4
|
|
| September 25, 2024 | 3B |
3.1
|
2.8
|
3.5
|
N/A
|
N/A
|
N/A
|
N/A
|
2.5
|
2.1
|
|
| September 26, 2024 | N/A |
2.6
|
2.3
|
2.9
|
N/A
|
N/A
|
N/A
|
N/A
|
3.6
|
3.4
|






