option

Code writing AI Model Scoring List - September 2024

Ranking
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
MODEL NAME RELEASE DATE PARAMETERS Code writing Code writing Code writing(ZH) Code writing(ZH) Code writing(EN) Code writing(EN) Code Competition(ZH) Code Competition(ZH) Code Competition(EN) Code Competition(EN) Code Instruct Execution(ZH) Code Instruct Execution(ZH) Code Instruct Execution(EN) Code Instruct Execution(EN) code Q&A(ZH) code Q&A(ZH) code Q&A(EN) code Q&A(EN)
Open Source·Alibaba
September 18, 2024 72B
7.4
7.5
7.3
N/A
N/A
N/A
N/A
6.2
6.3
Open Source·DeepSeek
September 4, 2024 236B
7.2
7.3
7.1
N/A
N/A
N/A
N/A
6.4
6.5
Closed Source·Anthropic
June 20, 2024 N/A
7.0
7.1
6.9
N/A
N/A
N/A
N/A
5.6
5.9
Closed Source·OpenAI
May 12, 2024 N/A
7.0
7.1
7.0
N/A
N/A
N/A
N/A
5.8
6.1
Closed Source·OpenAI
August 5, 2024 N/A
6.9
6.9
6.8
N/A
N/A
N/A
N/A
5.4
5.2
Closed Source·Zhipu AI
August 29, 2024 N/A
6.8
6.8
6.9
N/A
N/A
N/A
N/A
6.1
5.7
Open Source·Mistral AI
July 23, 2024 123B
6.7
6.6
6.8
N/A
N/A
N/A
N/A
5.7
6.0
Closed Source·OpenAI
July 17, 2024 N/A
6.4
6.6
6.3
N/A
N/A
N/A
N/A
5.5
5.3
Closed Source·Baidu
October 8, 2024 N/A
6.3
6.5
6.1
N/A
N/A
N/A
N/A
5.0
5.8
Closed Source·StepFun
July 3, 2024 N/A
6.2
6.3
6.1
N/A
N/A
N/A
N/A
6.1
6.4
Closed Source·ByteDance
August 27, 2024 N/A
6.2
6.5
5.9
N/A
N/A
N/A
N/A
3.6
4.9
Open Source·Alibaba
September 18, 2024 7B
5.9
5.7
6.1
N/A
N/A
N/A
N/A
5.0
5.1
Closed Source·Google
September 23, 2024 N/A
5.8
6.3
5.4
N/A
N/A
N/A
N/A
5.5
5.9
Closed Source·01.AI
May 12, 2024 N/A
5.7
5.8
5.6
N/A
N/A
N/A
N/A
4.5
4.7
Open Source·Meta
July 22, 2024 70B
5.7
5.6
5.7
N/A
N/A
N/A
N/A
4.9
4.4
Open Source·Meta
July 22, 2024 70B
5.6
5.3
5.9
N/A
N/A
N/A
N/A
4.4
3.8
Closed Source·Tencent
May 20, 2024 N/A
5.5
5.6
5.4
N/A
N/A
N/A
N/A
5.7
5.5
Open Source·Google
June 26, 2024 27B
5.5
5.5
5.4
N/A
N/A
N/A
N/A
4.9
4.9
Closed Source·Moonshot
August 31, 2024 N/A
5.2
5.3
5.1
N/A
N/A
N/A
N/A
4.6
4.9
Closed Source·MiniMax
April 16, 2024 N/A
5.1
5.1
5.0
N/A
N/A
N/A
N/A
4.2
4.4
Open Source·Mistral AI
September 16, 2024 22B
5.0
5.0
4.9
N/A
N/A
N/A
N/A
4.7
4.5
Open Source·Zhipu AI
June 3, 2024 9B
4.4
4.4
4.4
N/A
N/A
N/A
N/A
3.5
3.6
Open Source·Google
June 26, 2024 9B
4.3
4.5
4.2
N/A
N/A
N/A
N/A
3.6
4.0
Open Source·01.AI
May 11, 2024 9B
4.2
3.8
4.5
N/A
N/A
N/A
N/A
4.3
3.9
Closed Source·Baichuan
May 21, 2024 N/A
4.1
4.1
4.0
N/A
N/A
N/A
N/A
4.1
4.6
Open Source·Mistral AI
July 17, 2024 12B
4.1
3.5
4.6
N/A
N/A
N/A
N/A
4.6
3.5
Open Source·Meta
July 22, 2024 8B
4.0
3.7
4.2
N/A
N/A
N/A
N/A
4.0
3.4
Open Source·Shanghai AI Laboratory
July 4, 2024 7B
3.5
3.5
3.4
N/A
N/A
N/A
N/A
2.2
2.4
Open Source·Meta
September 24, 2024 3B
3.1
2.8
3.5
N/A
N/A
N/A
N/A
2.5
2.1
Closed Source·Dianxin
September 25, 2024 N/A
2.6
2.3
2.9
N/A
N/A
N/A
N/A
3.6
3.4
Back to Top
OR