option

Code writing AI Model Scoring List - May 2024

Ranking
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
MODEL NAME RELEASE DATE PARAMETERS Code writing Code writing Code writing(ZH) Code writing(ZH) Code writing(EN) Code writing(EN) Code Competition(ZH) Code Competition(ZH) Code Competition(EN) Code Competition(EN) Code Instruct Execution(ZH) Code Instruct Execution(ZH) Code Instruct Execution(EN) Code Instruct Execution(EN) code Q&A(ZH) code Q&A(ZH) code Q&A(EN) code Q&A(EN)
Closed Source·OpenAI
May 12, 2024 N/A
6.5
7.1
6.1
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·OpenAI
April 8, 2024 N/A
6.1
6.6
5.8
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·DeepSeek
May 5, 2024 236B
5.7
6.4
5.2
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Anthropic
March 3, 2024 N/A
5.5
5.6
5.4
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·iFLYTEK
May 27, 2024 N/A
5.3
5.6
5.1
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·ByteDance
May 14, 2024 N/A
5.2
5.9
4.8
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Baidu
May 17, 2024 N/A
5.1
4.1
4.0
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·01.AI
May 12, 2024 N/A
5.0
5.9
4.5
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·MiniMax
April 16, 2024 N/A
5.0
5.3
4.8
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Mistral AI
April 16, 2024 141B
5.0
5.2
4.8
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Alibaba
April 27, 2024 N/A
4.9
5.3
4.6
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Moonshot
April 25, 2024 N/A
4.8
4.9
4.7
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·01.AI
May 11, 2024 9B
4.7
5.0
4.5
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·OpenAI
June 12, 2023 N/A
4.7
5.2
4.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Meta
April 17, 2024 70B
4.6
5.6
4.0
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·01.AI
May 11, 2024 34B
4.6
4.7
4.5
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Baichuan
May 21, 2024 N/A
4.5
4.8
4.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
April 24, 2024 110B
4.5
4.9
4.2
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Zhipu AI
January 15, 2024 N/A
4.4
5.0
4.1
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·01.AI
May 11, 2024 6B
4.1
4.2
4.0
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·StepFun
May 7, 2024 N/A
4.0
4.1
3.9
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Cohere For AI
April 2, 2024 104B
3.9
4.1
3.7
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Shanghai AI Laboratory
January 10, 2024 20B
3.9
4.2
3.7
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Nanbeige
March 23, 2024 8B
3.9
3.9
3.8
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
February 3, 2024 72B
3.8
4.0
3.7
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Mistral AI
February 25, 2024 N/A
3.8
4.3
3.5
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·DataBricks
March 25, 2024 132B
3.7
3.8
3.6
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
April 2, 2024 32B
3.5
3.6
3.5
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Qihoo 360
April 8, 2024 N/A
3.4
3.5
3.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Meta
April 17, 2024 8B
3.4
4.2
3.0
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Shanghai AI Laboratory
January 10, 2024 7B
3.3
3.5
3.2
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Nanbeige
May 27, 2024 16B
3.2
3.5
3.1
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·DeepSeek
May 14, 2024 16B
3.2
3.2
3.2
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
February 3, 2024 14B
3.0
3.2
2.9
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Zhipu AI
October 26, 2023 6B
2.6
2.9
2.5
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Mistral AI
May 21, 2024 7B
2.5
2.7
2.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
February 3, 2024 7B
2.4
2.3
2.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·China Telecom
May 19, 2024 52B
2.0
2.1
2.0
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Mistral AI
December 10, 2023 47B
1.8
1.7
1.9
N/A
N/A
N/A
N/A
N/A
N/A
Back to Top
OR