Language dialogue AI Model Scoring List - July 2024

July 2024

Ranking



4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36

MODEL NAME	RELEASE DATE	PARAMETERS	Language dialogue	Language dialogue(ZH)	Language dialogue(EN)	nlp(ZH)	nlp(EN)	creation(ZH)	creation(EN)	dialogue(ZH)	dialogue(EN)
Qwen-Max-0428 Closed Source·Alibaba	April 28, 2024	N/A	5.6	6.0	5.2	5.7	4.4	6.4	5.2	6.1	5.9
GPT-4o-20240513 Closed Source·OpenAI	May 13, 2024	N/A	5.5	5.9	5.1	5.5	5.0	5.7	5.2	6.5	5.1
Qwen1.5-110B-Chat Open Source·Alibaba	April 25, 2024	110B	5.3	5.6	5.0	5.7	4.3	5.6	4.8	5.5	5.7
Claude 3.5 Sonnet 20240620 Closed Source·Anthropic	June 21, 2024	N/A	5.0	5.1	5.0	6.3	5.8	4.8	5.5	4.1	3.7
Mistral-Large Closed Source·Mistral AI	February 26, 2024	N/A	5.0	5.0	5.1	4.8	5.5	4.5	5.0	5.8	4.7
Mistral-Large-Instruct-2407 Open Source·Mistral AI	July 24, 2024	123B	5.0	5.0	5.0	4.7	5.1	4.5	5.1	5.8	4.7
GPT-4o-mini-20240718 Closed Source·OpenAI	July 18, 2024	N/A	5.0	5.0	5.0	4.9	4.8	4.7	5.0	5.2	5.1
Yi-1.5-34B-Chat Open Source·01.AI	May 12, 2024	34B	5.0	5.1	5.0	4.8	4.6	4.9	4.6	5.4	5.7
Nanbeige2-16B-Chat Open Source·Nanbeige	May 28, 2024	16B	5.0	5.4	4.6	5.5	4.4	5.0	4.3	5.8	5.2
Yi-Large Closed Source·01.AI	May 13, 2024	N/A	4.8	4.8	4.9	5.1	4.8	4.4	4.5	4.9	5.3
DeepSeek-V2-Chat-0628 Open Source·DeepSeek	May 6, 2024	236B	4.6	4.7	4.5	5.2	4.6	4.5	4.2	4.5	4.6
Moonshot-v1-8K Closed Source·Moonshot	April 26, 2024	N/A	4.6	4.7	4.5	5.2	4.7	4.2	3.9	4.6	4.9
Yi-1.5-9B-Chat Open Source·01.AI	May 12, 2024	9B	4.6	4.8	4.4	4.6	3.9	4.4	4.1	5.3	5.1
Qwen2-72B-Instruct Open Source·Alibaba	June 6, 2024	72B	4.5	5.2	3.8	6.3	4.2	4.2	2.7	5.2	4.6
GLM-4-0520 Closed Source·Zhipu AI	January 16, 2024	N/A	4.5	4.3	4.7	4.7	4.6	3.5	4.5	4.8	5.1
Gemma-2-27B-it Open Source·Google	June 27, 2024	27B	4.5	4.6	4.3	5.3	5.0	4.1	4.3	4.4	3.7
abab6.5-chat Closed Source·MiniMax	April 17, 2024	N/A	4.4	4.6	4.3	4.9	4.6	4.2	3.9	4.7	4.2
GLM-4-9B-Chat Open Source·Zhipu AI	June 4, 2024	9B	4.4	4.3	4.5	4.5	3.9	3.3	4.1	5.1	5.5
InternLM2.5-Chat-7B Open Source·Shanghai AI Laboratory	July 5, 2024	7B	4.4	5.0	3.8	5.7	3.7	4.1	3.4	5.2	4.4
Qwen2-7B-Instruct Open Source·Alibaba	June 6, 2024	7B	4.3	5.2	3.4	5.9	3.3	4.5	3.2	5.1	3.9
Yi-1.5-6B-Chat Open Source·01.AI	May 12, 2024	6B	4.3	4.8	3.9	4.6	3.4	4.6	3.5	5.1	4.7
Step-1-8K Closed Source·StepFun	May 8, 2024	N/A	4.0	4.3	3.7	5.4	4.3	3.4	2.7	4.1	4.2
Gemma-2-9B-it Open Source·Google	June 27, 2024	9B	4.0	4.1	3.9	5.1	4.6	3.7	3.7	3.6	3.5
Llama3.1-70B-Instruct Open Source·Meta	July 23, 2024	70B	3.8	2.8	4.8	3.5	5.4	2.4	4.1	2.6	4.8
Baichuan4 Closed Source·Baichuan	May 22, 2024	N/A	3.7	3.9	3.4	4.5	3.6	3.3	3.4	4.0	3.3
Ernie-4.0-8K-Preview-0518 Closed Source·Baidu	May 18, 2024	N/A	3.6	4.2	3.1	4.9	3.6	2.5	1.8	5.1	3.9
InternLM2-Chat-20B Open Source·Shanghai AI Laboratory	January 11, 2024	20B	3.6	4.0	3.3	4.0	2.7	3.4	3.0	4.6	4.0
Mixtral-8x7B-Instruct-v0.1 Open Source·Mistral AI	December 11, 2023	47B	3.6	3.4	3.8	3.4	3.4	3.5	4.0	3.3	4.0
Mixtral-8x22B-Instruct-v0.1 Open Source·Mistral AI	April 17, 2024	141B	3.3	2.7	3.8	3.3	4.0	2.1	3.4	2.7	4.1
Llama3.1-8B-Instruct Open Source·Meta	July 23, 2024	8B	3.3	2.1	4.5	3.2	4.7	1.7	4.0	1.6	4.9
Doubao-pro-32k/240615 Closed Source·ByteDance	June 15, 2024	N/A	3.1	3.8	2.4	4.1	2.9	3.0	2.4	4.1	1.8
DeepSeek-V2-Lite-Chat Open Source·DeepSeek	May 15, 2024	16B	3.1	3.4	2.8	4.0	2.7	3.4	2.8	2.8	2.9
Hunyuan-Standard-256k Closed Source·Tencent	May 21, 2024	N/A	3.0	3.5	2.6	3.9	3.1	2.0	1.8	4.5	2.8
Mistral-7B-Instruct-v0.3 Open Source·Mistral AI	May 22, 2024	7B	3.0	2.5	3.5	3.0	3.2	2.1	3.4	2.3	4.0
Spark-v4-Ultra Closed Source·iFLYTEK	June 28, 2024	N/A	2.9	4.3	1.4	4.7	2.2	3.4	9.7	4.8	1.1
DBRX-Instruct Open Source·DataBricks	March 26, 2024	132B	2.5	2.4	2.7	3.5	3.1	2.0	2.8	1.6	2.1