option

Code writing AI Model Scoring List - November 2024

Ranking
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
MODEL NAME RELEASE DATE PARAMETERS Code writing Code writing Code writing(ZH) Code writing(ZH) Code writing(EN) Code writing(EN) Code Competition(ZH) Code Competition(ZH) Code Competition(EN) Code Competition(EN) Code Instruct Execution(ZH) Code Instruct Execution(ZH) Code Instruct Execution(EN) Code Instruct Execution(EN) code Q&A(ZH) code Q&A(ZH) code Q&A(EN) code Q&A(EN)
Closed Source·OpenAI
September 12, 2024 N/A
7.9
7.9
7.9
N/A
N/A
N/A
N/A
8.2
8.2
Closed Source·Anthropic
October 22, 2024 N/A
5.7
5.4
5.3
N/A
N/A
N/A
N/A
6.8
6.6
Closed Source·Google
November 29, 2024 N/A
5.4
5.1
4.9
N/A
N/A
N/A
N/A
6.9
6.3
Closed Source·OpenAI
November 20, 2024 N/A
5.3
5.1
4.8
N/A
N/A
N/A
N/A
6.8
5.9
Closed Source·Zhipu AI
August 30, 2024 N/A
4.9
4.8
4.7
N/A
N/A
N/A
N/A
5.7
5.5
Closed Source·xAI
August 13, 2024 N/A
4.8
4.5
4.5
N/A
N/A
N/A
N/A
5.7
5.8
Open Source·Alibaba
September 19, 2024 72B
4.7
4.4
4.3
N/A
N/A
N/A
N/A
6.0
5.7
Open Source·DeepSeek
September 5, 2024 236B
4.7
4.5
4.2
N/A
N/A
N/A
N/A
6.0
5.2
Closed Source·360 Zhinao
November 29, 2024 N/A
4.6
4.4
4.2
N/A
N/A
N/A
N/A
5.7
5.2
Closed Source·01.AI
October 16, 2024 N/A
4.5
4.2
4.0
N/A
N/A
N/A
N/A
6.2
5.6
Closed Source·Ant Group
November 15, 2024 N/A
4.4
4.1
4.0
N/A
N/A
N/A
N/A
5.6
5.5
Open Source·Mistral AI
November 18, 2024 123B
4.3
4.0
3.9
N/A
N/A
N/A
N/A
5.2
5.2
Closed Source·MiniMax
November 6, 2024 N/A
4.3
4.0
4.0
N/A
N/A
N/A
N/A
5.5
5.2
Closed Source·OpenAI
August 6, 2024 N/A
4.2
4.0
4.0
N/A
N/A
N/A
N/A
5.0
5.0
Open Source·Meta
July 23, 2024 405B
4.2
4.0
4.1
N/A
N/A
N/A
N/A
4.2
4.7
Closed Source·Ant Group
November 15, 2024 N/A
4.1
3.8
3.8
N/A
N/A
N/A
N/A
5.3
5.2
Closed Source·StepFun
July 4, 2024 N/A
4.0
3.8
3.7
N/A
N/A
N/A
N/A
5.0
4.7
Closed Source·Baidu
November 15, 2024 N/A
4.0
3.8
3.6
N/A
N/A
N/A
N/A
5.4
4.8
Closed Source·TeleAI
September 26, 2024 N/A
3.9
3.5
3.4
N/A
N/A
N/A
N/A
5.2
5.1
Closed Source·ByteDance
August 28, 2024 N/A
3.7
3.9
3.6
N/A
N/A
N/A
N/A
4.1
3.3
Closed Source·iFLYTEK
June 28, 2024 N/A
3.7
3.4
3.4
N/A
N/A
N/A
N/A
4.5
4.5
Closed Source·Tencent
October 28, 2024 N/A
3.6
3.2
3.2
N/A
N/A
N/A
N/A
4.7
4.8
Closed Source·Baidu
November 15, 2024 N/A
3.6
3.7
3.4
N/A
N/A
N/A
N/A
4.1
3.1
Open Source·Google
June 27, 2024 27B
3.4
3.2
3.1
N/A
N/A
N/A
N/A
4.3
3.9
Open Source·Alibaba
September 19, 2024 7B
3.3
3.0
2.9
N/A
N/A
N/A
N/A
4.4
4.2
Open Source·Meta
July 23, 2024 70B
3.3
3.0
3.2
N/A
N/A
N/A
N/A
3.6
4.2
Closed Source·Moonshot
September 1, 2024 N/A
3.1
3.0
2.8
N/A
N/A
N/A
N/A
4.2
3.5
Closed Source·Baichuan
May 22, 2024 N/A
3.1
3.0
2.9
N/A
N/A
N/A
N/A
3.9
3.5
Open Source·Mistral AI
September 17, 2024 22B
3.1
2.7
2.7
N/A
N/A
N/A
N/A
4.4
4.2
Open Source·01.AI
May 12, 2024 34B
3.0
2.7
2.8
N/A
N/A
N/A
N/A
3.7
4.0
Open Source·01.AI
May 12, 2024 9B
3.0
2.8
2.9
N/A
N/A
N/A
N/A
3.3
3.5
Open Source·Google
June 27, 2024 9B
2.8
2.6
2.5
N/A
N/A
N/A
N/A
3.5
3.3
Open Source·Zhipu AI
June 4, 2024 9B
2.6
2.3
2.4
N/A
N/A
N/A
N/A
2.9
3.2
Open Source·Mistral AI
October 16, 2024 8B
2.5
2.0
2.1
N/A
N/A
N/A
N/A
3.8
3.9
Open Source·360 Zhinao
November 21, 2024 7B
2.3
2.4
2.0
N/A
N/A
N/A
N/A
3.4
2.1
Open Source·Meta
July 23, 2024 8B
2.0
1.5
1.7
N/A
N/A
N/A
N/A
2.8
3.2
Open Source·Meta
September 25, 2024 3B
1.1
8.2
1.0
N/A
N/A
N/A
N/A
1.2
2.0
Back to Top
OR