option

Code writing AI Model Scoring List - May 2024

Ranking
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
MODEL NAME RELEASE DATE PARAMETERS Code writing Code writing Code writing(ZH) Code writing(ZH) Code writing(EN) Code writing(EN) Code Competition(ZH) Code Competition(ZH) Code Competition(EN) Code Competition(EN) Code Instruct Execution(ZH) Code Instruct Execution(ZH) Code Instruct Execution(EN) Code Instruct Execution(EN) code Q&A(ZH) code Q&A(ZH) code Q&A(EN) code Q&A(EN)
Closed Source·OpenAI
May 13, 2024 N/A
6.5
7.1
6.1
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·OpenAI
April 9, 2024 N/A
6.1
6.6
5.8
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·DeepSeek
May 6, 2024 236B
5.7
6.4
5.2
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Anthropic
March 4, 2024 N/A
5.5
5.6
5.4
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·iFLYTEK
May 28, 2024 N/A
5.3
5.6
5.1
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·ByteDance
May 15, 2024 N/A
5.2
5.9
4.8
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Baidu
May 18, 2024 N/A
5.1
4.1
4.0
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·01.AI
May 13, 2024 N/A
5.0
5.9
4.5
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·MiniMax
April 17, 2024 N/A
5.0
5.3
4.8
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Mistral AI
April 17, 2024 141B
5.0
5.2
4.8
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Alibaba
April 28, 2024 N/A
4.9
5.3
4.6
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Moonshot
April 26, 2024 N/A
4.8
4.9
4.7
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·01.AI
May 12, 2024 9B
4.7
5.0
4.5
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·OpenAI
June 13, 2023 N/A
4.7
5.2
4.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Meta
April 18, 2024 70B
4.6
5.6
4.0
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·01.AI
May 12, 2024 34B
4.6
4.7
4.5
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Baichuan
May 22, 2024 N/A
4.5
4.8
4.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
April 25, 2024 110B
4.5
4.9
4.2
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Zhipu AI
January 16, 2024 N/A
4.4
5.0
4.1
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·01.AI
May 12, 2024 6B
4.1
4.2
4.0
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·StepFun
May 8, 2024 N/A
4.0
4.1
3.9
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Cohere For AI
April 3, 2024 104B
3.9
4.1
3.7
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Shanghai AI Laboratory
January 11, 2024 20B
3.9
4.2
3.7
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Nanbeige
March 24, 2024 8B
3.9
3.9
3.8
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
February 4, 2024 72B
3.8
4.0
3.7
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Mistral AI
February 26, 2024 N/A
3.8
4.3
3.5
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·DataBricks
March 26, 2024 132B
3.7
3.8
3.6
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
April 3, 2024 32B
3.5
3.6
3.5
N/A
N/A
N/A
N/A
N/A
N/A
Closed Source·Qihoo 360
April 9, 2024 N/A
3.4
3.5
3.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Meta
April 18, 2024 8B
3.4
4.2
3.0
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Shanghai AI Laboratory
January 11, 2024 7B
3.3
3.5
3.2
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Nanbeige
May 28, 2024 16B
3.2
3.5
3.1
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·DeepSeek
May 15, 2024 16B
3.2
3.2
3.2
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
February 4, 2024 14B
3.0
3.2
2.9
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Zhipu AI
October 27, 2023 6B
2.6
2.9
2.5
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Mistral AI
May 22, 2024 7B
2.5
2.7
2.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Alibaba
February 4, 2024 7B
2.4
2.3
2.4
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·China Telecom
May 20, 2024 52B
2.0
2.1
2.0
N/A
N/A
N/A
N/A
N/A
N/A
Open Source·Mistral AI
December 11, 2023 47B
1.8
1.7
1.9
N/A
N/A
N/A
N/A
N/A
N/A
Back to Top
OR