Command following AI Model Scoring List - July 2024

July 2024

Ranking



4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36

MODEL NAME	RELEASE DATE	PARAMETERS	instruct	instruct(ZH)	instruct(EN)
Claude 3.5 Sonnet 20240620 Closed Source·Anthropic	June 20, 2024	N/A	6.6	6.5	6.7
GPT-4o-20240513 Closed Source·OpenAI	May 12, 2024	N/A	6.0	6.1	5.9
GPT-4o-mini-20240718 Closed Source·OpenAI	July 17, 2024	N/A	5.6	5.7	5.5
Mistral-Large Closed Source·Mistral AI	February 25, 2024	N/A	5.1	5.1	5.1
Mistral-Large-Instruct-2407 Open Source·Mistral AI	July 23, 2024	123B	5.0	5.1	4.9
Qwen-Max-0428 Closed Source·Alibaba	April 27, 2024	N/A	4.7	5.0	4.4
Llama3.1-70B-Instruct Open Source·Meta	July 22, 2024	70B	4.6	4.1	5.1
Gemma-2-27B-it Open Source·Google	June 26, 2024	27B	4.5	4.5	4.4
DeepSeek-V2-Chat-0628 Open Source·DeepSeek	May 5, 2024	236B	4.4	4.7	4.1
Yi-Large Closed Source·01.AI	May 12, 2024	N/A	4.0	4.0	3.9
Gemma-2-9B-it Open Source·Google	June 26, 2024	9B	4.0	4.2	3.9
Baichuan4 Closed Source·Baichuan	May 21, 2024	N/A	3.9	3.8	4.0
Llama3.1-8B-Instruct Open Source·Meta	July 22, 2024	8B	3.9	3.2	4.5
Step-1-8K Closed Source·StepFun	May 7, 2024	N/A	3.8	4.5	3.2
Yi-1.5-34B-Chat Open Source·01.AI	May 11, 2024	34B	3.8	3.9	3.8
GLM-4-0520 Closed Source·Zhipu AI	January 15, 2024	N/A	3.6	3.9	3.4
Qwen1.5-110B-Chat Open Source·Alibaba	April 24, 2024	110B	3.6	3.8	3.5
GLM-4-9B-Chat Open Source·Zhipu AI	June 3, 2024	9B	3.6	3.2	3.9
Moonshot-v1-8K Closed Source·Moonshot	April 25, 2024	N/A	3.5	3.6	3.5
Qwen2-72B-Instruct Open Source·Alibaba	June 5, 2024	72B	3.4	3.5	3.2
Nanbeige2-16B-Chat Open Source·Nanbeige	May 27, 2024	16B	3.3	3.4	3.2
abab6.5-chat Closed Source·MiniMax	April 16, 2024	N/A	3.2	2.9	3.4
DBRX-Instruct Open Source·DataBricks	March 25, 2024	132B	3.2	2.9	3.6
Mixtral-8x22B-Instruct-v0.1 Open Source·Mistral AI	April 16, 2024	141B	3.1	2.8	3.4
Doubao-pro-32k/240615 Closed Source·ByteDance	June 14, 2024	N/A	3.0	3.4	2.6
Hunyuan-Standard-256k Closed Source·Tencent	May 20, 2024	N/A	2.9	2.8	2.9
Yi-1.5-9B-Chat Open Source·01.AI	May 11, 2024	9B	2.9	3.1	2.8
Ernie-4.0-8K-Preview-0518 Closed Source·Baidu	May 17, 2024	N/A	2.8	3.3	2.3
Mixtral-8x7B-Instruct-v0.1 Open Source·Mistral AI	December 10, 2023	47B	2.8	2.9	2.7
Mistral-7B-Instruct-v0.3 Open Source·Mistral AI	May 21, 2024	7B	2.8	2.7	3.0
Qwen2-7B-Instruct Open Source·Alibaba	June 5, 2024	7B	2.7	3.1	2.3
InternLM2.5-Chat-7B Open Source·Shanghai AI Laboratory	July 4, 2024	7B	2.6	2.9	2.3
Yi-1.5-6B-Chat Open Source·01.AI	May 11, 2024	6B	2.6	2.6	2.6
Spark-v4-Ultra Closed Source·iFLYTEK	June 27, 2024	N/A	2.5	2.8	2.3
DeepSeek-V2-Lite-Chat Open Source·DeepSeek	May 14, 2024	16B	2.0	2.1	2.0
InternLM2-Chat-20B Open Source·Shanghai AI Laboratory	January 10, 2024	20B	1.8	2.2	1.5