option

Code writing AI Model Scoring List - January 2025

Ranking
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
MODEL NAME RELEASE DATE PARAMETERS Code writing Code writing Code writing(ZH) Code writing(ZH) Code writing(EN) Code writing(EN) Code Competition(ZH) Code Competition(ZH) Code Competition(EN) Code Competition(EN) Code Instruct Execution(ZH) Code Instruct Execution(ZH) Code Instruct Execution(EN) Code Instruct Execution(EN) code Q&A(ZH) code Q&A(ZH) code Q&A(EN) code Q&A(EN)
Open Source·DeepSeek
January 20, 2025 671B
5.5
5.7
5.3
6.3
6.8
2.8
3.0
7.9
6.0
Closed Source·OpenAI
December 17, 2024 N/A
5.5
5.8
5.1
7.3
7.0
3.0
3.1
7.2
5.3
Closed Source·OpenAI
September 12, 2024 N/A
5.5
5.5
5.5
6.0
5.9
2.3
2.5
8.1
8.0
Closed Source·OpenAI
January 31, 2025 N/A
5.3
5.4
5.1
6.0
6.5
3.1
2.8
7.3
5.9
Closed Source·Google
February 5, 2025 N/A
5.1
5.1
5.2
5.0
5.4
2.5
2.9
7.7
7.4
Closed Source·Alibaba
January 28, 2025 N/A
5.1
5.2
5.0
5.7
5.4
2.5
2.9
7.4
6.8
Closed Source·Google
February 5, 2025 N/A
4.7
4.8
4.5
5.2
4.5
1.9
2.5
7.4
6.3
Open Source·DeepSeek
December 26, 2024 671B
4.5
4.5
4.6
5.4
5.2
2.0
2.7
6.1
5.8
Closed Source·Anthropic
October 22, 2024 N/A
4.5
4.9
4.2
5.0
4.5
2.2
2.2
7.5
5.8
Closed Source·ByteDance
January 22, 2025 N/A
4.4
4.6
4.2
5.0
5.5
2.0
2.2
6.8
5.0
Closed Source·OpenAI
November 20, 2024 N/A
4.4
4.4
4.5
4.2
4.5
2.1
2.8
6.9
6.1
Open Source·MiniMax
January 15, 2025 456B
4.3
4.3
4.3
2.9
3.7
1.8
2.4
8.0
6.9
Open Source·Alibaba
November 28, 2024 32B
4.2
3.9
4.4
4.2
5.4
1.7
2.3
5.9
5.4
Closed Source·StepFun
January 16, 2025 N/A
4.1
4.1
4.1
4.1
3.2
1.9
2.6
6.2
6.4
Closed Source·Zhipu AI
August 30, 2024 N/A
4.1
4.2
4.0
4.7
4.2
2.3
2.1
5.5
5.6
Closed Source·01.AI
October 16, 2024 N/A
4.1
4.0
4.1
4.2
4.5
1.7
2.0
6.2
5.7
Closed Source·Baidu
November 15, 2024 N/A
4.0
3.9
4.2
3.9
5.0
1.9
2.5
5.8
5.2
Open Source·Mistral AI
November 18, 2024 123B
3.9
3.7
4.0
4.1
4.9
1.8
2.4
5.3
4.8
Closed Source·Ant Group
November 20, 2024 N/A
3.8
3.8
3.8
4.1
4.4
1.7
2.0
5.6
5.1
Closed Source·OpenAI
July 18, 2024 N/A
3.8
3.8
3.8
4.2
3.9
2.2
2.4
5.0
5.1
Closed Source·Tencent
February 10, 2024 N/A
3.7
4.1
3.3
3.2
2.6
1.7
1.9
7.5
5.5
Open Source·Meta
July 23, 2024 70B
3.6
3.5
3.8
3.9
3.9
2.0
2.5
4.4
5.0
Closed Source·Zhipu AI
December 31, 2024 N/A
3.5
3.5
3.4
4.1
3.2
6.1
1.3
6.0
5.6
Open Source·Alibaba
September 19, 2024 72B
3.5
3.5
3.4
4.7
4.5
2.3
2.3
6.3
5.4
Closed Source·Ant Group
November 16, 2024 N/A
3.3
3.5
3.1
2.9
2.7
1.9
1.7
5.7
4.8
Open Source·Meta
July 23, 2024 70B
3.2
3.2
3.1
4.1
3.2
1.8
2.0
3.9
4.0
Closed Source·iFLYTEK
June 28, 2024 N/A
3.1
3.1
3.0
3.7
3.1
1.6
1.9
4.1
3.9
Open Source·Shanghai AI Laboratory
January 15, 2025 8B
3.0
3.3
2.7
3.1
2.7
1.6
1.2
5.3
4.2
Open Source·Google
June 27, 2024 27B
3.0
3.1
2.8
3.4
3.6
1.4
1.6
4.5
3.3
Open Source·Mistral AI
September 17, 2024 22B
2.6
2.6
2.6
2.6
2.7
1.0
1.0
4.2
4.0
Closed Source·Moonshot
September 1, 2024 N/A
2.4
2.4
2.3
2.2
1.6
1.4
2.0
3.5
3.4
Open Source·Mistral AI
October 16, 2024 8B
2.2
2.2
2.3
2.1
2.4
1.0
1.6
3.5
2.8
Open Source·Google
June 27, 2024 9B
2.0
2.0
1.9
1.9
2.4
1.0
8.8
3.2
2.5
Open Source·Meta
July 23, 2024 8B
2.0
1.9
2.0
1.8
1.3
1.2
1.8
2.8
2.8
Open Source·Alibaba
September 19, 2024 7B
1.9
1.5
2.2
1.8
2.9
1.3
1.6
4.1
4.2
Open Source·Zhipu AI
June 4, 2024 9B
1.9
1.8
2.0
1.6
2.6
1.2
1.0
2.6
2.5
Open Source·360 Zhinao
November 21, 2024 7B
1.5
1.6
1.5
1.3
1.8
4.7
7.4
3.1
2.0
Open Source·01.AI
May 12, 2024 9B
1.2
1.1
1.3
1.4
1.8
7.4
9.5
2.9
2.6
Open Source·Shanghai AI Laboratory
July 5, 2024 7B
1.2
1.1
1.2
1.1
1.6
5.4
9.5
1.8
1.2
Open Source·Meta
September 25, 2024 3B
1.2
1.0
1.3
8.2
1.3
5.4
1.0
1.7
1.8
Open Source·01.AI
May 12, 2024 34B
1.1
9.4
1.3
1.1
1.8
7.4
9.5
3.3
3.3
Back to Top
OR