option

Code writing AI Model Scoring List - January 2025

Ranking
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
MODEL NAME RELEASE DATE PARAMETERS Code writing Code writing Code writing(ZH) Code writing(ZH) Code writing(EN) Code writing(EN) Code Competition(ZH) Code Competition(ZH) Code Competition(EN) Code Competition(EN) Code Instruct Execution(ZH) Code Instruct Execution(ZH) Code Instruct Execution(EN) Code Instruct Execution(EN) code Q&A(ZH) code Q&A(ZH) code Q&A(EN) code Q&A(EN)
Open Source·DeepSeek
January 19, 2025 671B
5.5
5.7
5.3
6.3
6.8
2.8
3.0
7.9
6.0
Closed Source·OpenAI
December 16, 2024 N/A
5.5
5.8
5.1
7.3
7.0
3.0
3.1
7.2
5.3
Closed Source·OpenAI
September 11, 2024 N/A
5.5
5.5
5.5
6.0
5.9
2.3
2.5
8.1
8.0
Closed Source·OpenAI
January 30, 2025 N/A
5.3
5.4
5.1
6.0
6.5
3.1
2.8
7.3
5.9
Closed Source·Google
February 4, 2025 N/A
5.1
5.1
5.2
5.0
5.4
2.5
2.9
7.7
7.4
Closed Source·Alibaba
January 27, 2025 N/A
5.1
5.2
5.0
5.7
5.4
2.5
2.9
7.4
6.8
Closed Source·Google
February 4, 2025 N/A
4.7
4.8
4.5
5.2
4.5
1.9
2.5
7.4
6.3
Open Source·DeepSeek
December 25, 2024 671B
4.5
4.5
4.6
5.4
5.2
2.0
2.7
6.1
5.8
Closed Source·Anthropic
October 21, 2024 N/A
4.5
4.9
4.2
5.0
4.5
2.2
2.2
7.5
5.8
Closed Source·ByteDance
January 21, 2025 N/A
4.4
4.6
4.2
5.0
5.5
2.0
2.2
6.8
5.0
Closed Source·OpenAI
November 19, 2024 N/A
4.4
4.4
4.5
4.2
4.5
2.1
2.8
6.9
6.1
Open Source·MiniMax
January 14, 2025 456B
4.3
4.3
4.3
2.9
3.7
1.8
2.4
8.0
6.9
Open Source·Alibaba
November 27, 2024 32B
4.2
3.9
4.4
4.2
5.4
1.7
2.3
5.9
5.4
Closed Source·StepFun
January 15, 2025 N/A
4.1
4.1
4.1
4.1
3.2
1.9
2.6
6.2
6.4
Closed Source·Zhipu AI
August 29, 2024 N/A
4.1
4.2
4.0
4.7
4.2
2.3
2.1
5.5
5.6
Closed Source·01.AI
October 15, 2024 N/A
4.1
4.0
4.1
4.2
4.5
1.7
2.0
6.2
5.7
Closed Source·Baidu
November 14, 2024 N/A
4.0
3.9
4.2
3.9
5.0
1.9
2.5
5.8
5.2
Open Source·Mistral AI
November 17, 2024 123B
3.9
3.7
4.0
4.1
4.9
1.8
2.4
5.3
4.8
Closed Source·Ant Group
November 19, 2024 N/A
3.8
3.8
3.8
4.1
4.4
1.7
2.0
5.6
5.1
Closed Source·OpenAI
July 17, 2024 N/A
3.8
3.8
3.8
4.2
3.9
2.2
2.4
5.0
5.1
Closed Source·Tencent
February 9, 2024 N/A
3.7
4.1
3.3
3.2
2.6
1.7
1.9
7.5
5.5
Open Source·Meta
July 22, 2024 70B
3.6
3.5
3.8
3.9
3.9
2.0
2.5
4.4
5.0
Closed Source·Zhipu AI
December 30, 2024 N/A
3.5
3.5
3.4
4.1
3.2
6.1
1.3
6.0
5.6
Open Source·Alibaba
September 18, 2024 72B
3.5
3.5
3.4
4.7
4.5
2.3
2.3
6.3
5.4
Closed Source·Ant Group
November 15, 2024 N/A
3.3
3.5
3.1
2.9
2.7
1.9
1.7
5.7
4.8
Open Source·Meta
July 22, 2024 70B
3.2
3.2
3.1
4.1
3.2
1.8
2.0
3.9
4.0
Closed Source·iFLYTEK
June 27, 2024 N/A
3.1
3.1
3.0
3.7
3.1
1.6
1.9
4.1
3.9
Open Source·Shanghai AI Laboratory
January 14, 2025 8B
3.0
3.3
2.7
3.1
2.7
1.6
1.2
5.3
4.2
Open Source·Google
June 26, 2024 27B
3.0
3.1
2.8
3.4
3.6
1.4
1.6
4.5
3.3
Open Source·Mistral AI
September 16, 2024 22B
2.6
2.6
2.6
2.6
2.7
1.0
1.0
4.2
4.0
Closed Source·Moonshot
August 31, 2024 N/A
2.4
2.4
2.3
2.2
1.6
1.4
2.0
3.5
3.4
Open Source·Mistral AI
October 15, 2024 8B
2.2
2.2
2.3
2.1
2.4
1.0
1.6
3.5
2.8
Open Source·Google
June 26, 2024 9B
2.0
2.0
1.9
1.9
2.4
1.0
8.8
3.2
2.5
Open Source·Meta
July 22, 2024 8B
2.0
1.9
2.0
1.8
1.3
1.2
1.8
2.8
2.8
Open Source·Alibaba
September 18, 2024 7B
1.9
1.5
2.2
1.8
2.9
1.3
1.6
4.1
4.2
Open Source·Zhipu AI
June 3, 2024 9B
1.9
1.8
2.0
1.6
2.6
1.2
1.0
2.6
2.5
Open Source·360 Zhinao
November 20, 2024 7B
1.5
1.6
1.5
1.3
1.8
4.7
7.4
3.1
2.0
Open Source·01.AI
May 11, 2024 9B
1.2
1.1
1.3
1.4
1.8
7.4
9.5
2.9
2.6
Open Source·Shanghai AI Laboratory
July 4, 2024 7B
1.2
1.1
1.2
1.1
1.6
5.4
9.5
1.8
1.2
Open Source·Meta
September 24, 2024 3B
1.2
1.0
1.3
8.2
1.3
5.4
1.0
1.7
1.8
Open Source·01.AI
May 11, 2024 34B
1.1
9.4
1.3
1.1
1.8
7.4
9.5
3.3
3.3
Back to Top
OR