option

Code writing AI Model Scoring List - November 2024

Ranking
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
MODEL NAME RELEASE DATE PARAMETERS Code writing Code writing Code writing(ZH) Code writing(ZH) Code writing(EN) Code writing(EN) Code Competition(ZH) Code Competition(ZH) Code Competition(EN) Code Competition(EN) Code Instruct Execution(ZH) Code Instruct Execution(ZH) Code Instruct Execution(EN) Code Instruct Execution(EN) code Q&A(ZH) code Q&A(ZH) code Q&A(EN) code Q&A(EN)
Closed Source·OpenAI
September 11, 2024 N/A
7.9
7.9
7.9
N/A
N/A
N/A
N/A
8.2
8.2
Closed Source·Anthropic
October 21, 2024 N/A
5.7
5.4
5.3
N/A
N/A
N/A
N/A
6.8
6.6
Closed Source·Google
November 28, 2024 N/A
5.4
5.1
4.9
N/A
N/A
N/A
N/A
6.9
6.3
Closed Source·OpenAI
November 19, 2024 N/A
5.3
5.1
4.8
N/A
N/A
N/A
N/A
6.8
5.9
Closed Source·Zhipu AI
August 29, 2024 N/A
4.9
4.8
4.7
N/A
N/A
N/A
N/A
5.7
5.5
Closed Source·xAI
August 12, 2024 N/A
4.8
4.5
4.5
N/A
N/A
N/A
N/A
5.7
5.8
Open Source·Alibaba
September 18, 2024 72B
4.7
4.4
4.3
N/A
N/A
N/A
N/A
6.0
5.7
Open Source·DeepSeek
September 4, 2024 236B
4.7
4.5
4.2
N/A
N/A
N/A
N/A
6.0
5.2
Closed Source·360 Zhinao
November 28, 2024 N/A
4.6
4.4
4.2
N/A
N/A
N/A
N/A
5.7
5.2
Closed Source·01.AI
October 15, 2024 N/A
4.5
4.2
4.0
N/A
N/A
N/A
N/A
6.2
5.6
Closed Source·Ant Group
November 14, 2024 N/A
4.4
4.1
4.0
N/A
N/A
N/A
N/A
5.6
5.5
Open Source·Mistral AI
November 17, 2024 123B
4.3
4.0
3.9
N/A
N/A
N/A
N/A
5.2
5.2
Closed Source·MiniMax
November 5, 2024 N/A
4.3
4.0
4.0
N/A
N/A
N/A
N/A
5.5
5.2
Closed Source·OpenAI
August 5, 2024 N/A
4.2
4.0
4.0
N/A
N/A
N/A
N/A
5.0
5.0
Open Source·Meta
July 22, 2024 405B
4.2
4.0
4.1
N/A
N/A
N/A
N/A
4.2
4.7
Closed Source·Ant Group
November 14, 2024 N/A
4.1
3.8
3.8
N/A
N/A
N/A
N/A
5.3
5.2
Closed Source·StepFun
July 3, 2024 N/A
4.0
3.8
3.7
N/A
N/A
N/A
N/A
5.0
4.7
Closed Source·Baidu
November 14, 2024 N/A
4.0
3.8
3.6
N/A
N/A
N/A
N/A
5.4
4.8
Closed Source·TeleAI
September 25, 2024 N/A
3.9
3.5
3.4
N/A
N/A
N/A
N/A
5.2
5.1
Closed Source·ByteDance
August 27, 2024 N/A
3.7
3.9
3.6
N/A
N/A
N/A
N/A
4.1
3.3
Closed Source·iFLYTEK
June 27, 2024 N/A
3.7
3.4
3.4
N/A
N/A
N/A
N/A
4.5
4.5
Closed Source·Tencent
October 27, 2024 N/A
3.6
3.2
3.2
N/A
N/A
N/A
N/A
4.7
4.8
Closed Source·Baidu
November 14, 2024 N/A
3.6
3.7
3.4
N/A
N/A
N/A
N/A
4.1
3.1
Open Source·Google
June 26, 2024 27B
3.4
3.2
3.1
N/A
N/A
N/A
N/A
4.3
3.9
Open Source·Alibaba
September 18, 2024 7B
3.3
3.0
2.9
N/A
N/A
N/A
N/A
4.4
4.2
Open Source·Meta
July 22, 2024 70B
3.3
3.0
3.2
N/A
N/A
N/A
N/A
3.6
4.2
Closed Source·Moonshot
August 31, 2024 N/A
3.1
3.0
2.8
N/A
N/A
N/A
N/A
4.2
3.5
Closed Source·Baichuan
May 21, 2024 N/A
3.1
3.0
2.9
N/A
N/A
N/A
N/A
3.9
3.5
Open Source·Mistral AI
September 16, 2024 22B
3.1
2.7
2.7
N/A
N/A
N/A
N/A
4.4
4.2
Open Source·01.AI
May 11, 2024 34B
3.0
2.7
2.8
N/A
N/A
N/A
N/A
3.7
4.0
Open Source·01.AI
May 11, 2024 9B
3.0
2.8
2.9
N/A
N/A
N/A
N/A
3.3
3.5
Open Source·Google
June 26, 2024 9B
2.8
2.6
2.5
N/A
N/A
N/A
N/A
3.5
3.3
Open Source·Zhipu AI
June 3, 2024 9B
2.6
2.3
2.4
N/A
N/A
N/A
N/A
2.9
3.2
Open Source·Mistral AI
October 15, 2024 8B
2.5
2.0
2.1
N/A
N/A
N/A
N/A
3.8
3.9
Open Source·360 Zhinao
November 20, 2024 7B
2.3
2.4
2.0
N/A
N/A
N/A
N/A
3.4
2.1
Open Source·Meta
July 22, 2024 8B
2.0
1.5
1.7
N/A
N/A
N/A
N/A
2.8
3.2
Open Source·Meta
September 24, 2024 3B
1.1
8.2
1.0
N/A
N/A
N/A
N/A
1.2
2.0
Back to Top
OR