option

Code writing AI Model Scoring List - September 2024

Ranking
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
MODEL NAME RELEASE DATE PARAMETERS Code writing Code writing Code writing(ZH) Code writing(ZH) Code writing(EN) Code writing(EN) Code Competition(ZH) Code Competition(ZH) Code Competition(EN) Code Competition(EN) Code Instruct Execution(ZH) Code Instruct Execution(ZH) Code Instruct Execution(EN) Code Instruct Execution(EN) code Q&A(ZH) code Q&A(ZH) code Q&A(EN) code Q&A(EN)
Open Source·Alibaba
September 19, 2024 72B
7.4
7.5
7.3
N/A
N/A
N/A
N/A
6.2
6.3
Open Source·DeepSeek
September 5, 2024 236B
7.2
7.3
7.1
N/A
N/A
N/A
N/A
6.4
6.5
Closed Source·Anthropic
June 21, 2024 N/A
7.0
7.1
6.9
N/A
N/A
N/A
N/A
5.6
5.9
Closed Source·OpenAI
May 13, 2024 N/A
7.0
7.1
7.0
N/A
N/A
N/A
N/A
5.8
6.1
Closed Source·OpenAI
August 6, 2024 N/A
6.9
6.9
6.8
N/A
N/A
N/A
N/A
5.4
5.2
Closed Source·Zhipu AI
August 30, 2024 N/A
6.8
6.8
6.9
N/A
N/A
N/A
N/A
6.1
5.7
Open Source·Mistral AI
July 24, 2024 123B
6.7
6.6
6.8
N/A
N/A
N/A
N/A
5.7
6.0
Closed Source·OpenAI
July 18, 2024 N/A
6.4
6.6
6.3
N/A
N/A
N/A
N/A
5.5
5.3
Closed Source·Baidu
October 9, 2024 N/A
6.3
6.5
6.1
N/A
N/A
N/A
N/A
5.0
5.8
Closed Source·StepFun
July 4, 2024 N/A
6.2
6.3
6.1
N/A
N/A
N/A
N/A
6.1
6.4
Closed Source·ByteDance
August 28, 2024 N/A
6.2
6.5
5.9
N/A
N/A
N/A
N/A
3.6
4.9
Open Source·Alibaba
September 19, 2024 7B
5.9
5.7
6.1
N/A
N/A
N/A
N/A
5.0
5.1
Closed Source·Google
September 24, 2024 N/A
5.8
6.3
5.4
N/A
N/A
N/A
N/A
5.5
5.9
Closed Source·01.AI
May 13, 2024 N/A
5.7
5.8
5.6
N/A
N/A
N/A
N/A
4.5
4.7
Open Source·Meta
July 23, 2024 70B
5.7
5.6
5.7
N/A
N/A
N/A
N/A
4.9
4.4
Open Source·Meta
July 23, 2024 70B
5.6
5.3
5.9
N/A
N/A
N/A
N/A
4.4
3.8
Closed Source·Tencent
May 21, 2024 N/A
5.5
5.6
5.4
N/A
N/A
N/A
N/A
5.7
5.5
Open Source·Google
June 27, 2024 27B
5.5
5.5
5.4
N/A
N/A
N/A
N/A
4.9
4.9
Closed Source·Moonshot
September 1, 2024 N/A
5.2
5.3
5.1
N/A
N/A
N/A
N/A
4.6
4.9
Closed Source·MiniMax
April 17, 2024 N/A
5.1
5.1
5.0
N/A
N/A
N/A
N/A
4.2
4.4
Open Source·Mistral AI
September 17, 2024 22B
5.0
5.0
4.9
N/A
N/A
N/A
N/A
4.7
4.5
Open Source·Zhipu AI
June 4, 2024 9B
4.4
4.4
4.4
N/A
N/A
N/A
N/A
3.5
3.6
Open Source·Google
June 27, 2024 9B
4.3
4.5
4.2
N/A
N/A
N/A
N/A
3.6
4.0
Open Source·01.AI
May 12, 2024 9B
4.2
3.8
4.5
N/A
N/A
N/A
N/A
4.3
3.9
Closed Source·Baichuan
May 22, 2024 N/A
4.1
4.1
4.0
N/A
N/A
N/A
N/A
4.1
4.6
Open Source·Mistral AI
July 18, 2024 12B
4.1
3.5
4.6
N/A
N/A
N/A
N/A
4.6
3.5
Open Source·Meta
July 23, 2024 8B
4.0
3.7
4.2
N/A
N/A
N/A
N/A
4.0
3.4
Open Source·Shanghai AI Laboratory
July 5, 2024 7B
3.5
3.5
3.4
N/A
N/A
N/A
N/A
2.2
2.4
Open Source·Meta
September 25, 2024 3B
3.1
2.8
3.5
N/A
N/A
N/A
N/A
2.5
2.1
Closed Source·Dianxin
September 26, 2024 N/A
2.6
2.3
2.9
N/A
N/A
N/A
N/A
3.6
3.4
Back to Top
OR