Language dialogue AI Model Scoring List - November 2024

November 2024 Please select the month

Ranking



4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37

MODEL NAME	RELEASE DATE	PARAMETERS	Language dialogue	Language dialogue(ZH)	Language dialogue(EN)	nlp(ZH)	nlp(EN)	creation(ZH)	creation(EN)	dialogue(ZH)	dialogue(EN)
Yi-Lightning Closed Source·01.AI	October 16, 2024	N/A	6.3	6.6	6.1	6.5	6.1	6.2	5.4	7.0	6.7
GPT-4o-20241120 Closed Source·OpenAI	November 20, 2024	N/A	6.2	6.5	5.9	6.1	6.2	6.6	5.9	7.0	5.6
o1-mini-2024-09-12 Closed Source·OpenAI	September 12, 2024	N/A	6.1	6.1	6.0	6.3	6.1	6.4	5.7	5.7	6.2
GLM-4-Plus Closed Source·Zhipu AI	August 30, 2024	N/A	6.1	6.2	6.0	6.3	5.8	5.7	5.4	6.8	6.8
Grok-beta Closed Source·xAI	August 13, 2024	N/A	6.0	6.0	6.0	6.1	6.3	5.5	5.3	6.3	6.4
Bailing-Pro-1120 Closed Source·Ant Group	November 15, 2024	N/A	5.9	6.1	5.8	6.2	5.9	5.5	5.0	6.5	6.6
DeepSeek-V2.5 Open Source·DeepSeek	September 5, 2024	236B	5.8	6.0	5.6	5.8	5.4	6.0	5.0	6.3	6.5
TeleChat2 Closed Source·TeleAI	September 26, 2024	N/A	5.8	6.0	5.7	6.0	5.8	5.9	5.0	6.2	6.3
Gemini-1.5-Pro-Latest Closed Source·Google	November 29, 2024	N/A	5.7	5.9	5.6	5.7	5.4	5.9	5.3	6.1	5.9
Qwen2.5-72B-Instruct Open Source·Alibaba	September 19, 2024	72B	5.7	5.7	5.6	6.2	6.0	5.4	5.2	5.6	5.6
Bailing-Lite-1116 Closed Source·Ant Group	November 15, 2024	N/A	5.7	5.8	5.6	5.6	5.5	5.4	4.8	6.3	6.6
Step-2-16K Closed Source·StepFun	July 4, 2024	N/A	5.5	5.5	5.5	6.0	5.8	5.0	4.6	5.5	6.0
Mistral-Large-Instruct-2411 Open Source·Mistral AI	November 18, 2024	123B	5.4	5.2	5.5	5.3	5.6	5.0	5.0	5.5	5.8
ERNIE-4.0-Turbo-8K-Latest Closed Source·Baidu	November 15, 2024	N/A	5.2	5.1	5.2	5.0	5.1	4.7	4.6	5.7	5.8
Yi-1.5-34B-Chat Open Source·01.AI	May 12, 2024	34B	5.1	5.0	5.3	5.0	5.1	4.9	4.8	5.0	6.1
360gpt2-pro Closed Source·360 Zhinao	November 29, 2024	N/A	5.0	5.1	4.9	5.5	5.0	5.3	4.8	4.4	5.1
GPT-4o-20240806 Closed Source·OpenAI	August 6, 2024	N/A	5.0	5.0	5.0	5.0	5.0	5.0	5.0	5.0	5.0
abab7-chat-preview Closed Source·MiniMax	November 6, 2024	N/A	5.0	5.1	4.8	5.2	4.9	5.1	4.8	5.0	4.8
Claude 3.5 Sonnet 20241022 Closed Source·Anthropic	October 22, 2024	N/A	4.9	5.5	4.3	6.6	5.8	5.6	4.9	4.3	2.1
Doubao-pro-32k-240828 Closed Source·ByteDance	August 28, 2024	N/A	4.7	5.4	3.9	4.9	4.0	5.4	3.1	5.9	4.7
Llama3.1-405B-Instruct-FP8 Open Source·Meta	July 23, 2024	405B	4.7	4.4	5.0	5.1	5.6	3.7	4.2	4.4	5.4
Yi-1.5-9B-Chat Open Source·01.AI	May 12, 2024	9B	4.7	4.7	4.7	4.5	4.3	4.6	3.9	5.0	5.8
Spark-v4.0-Ultra Closed Source·iFLYTEK	June 28, 2024	N/A	4.6	4.7	4.6	4.8	4.6	4.3	4.6	5.0	4.5
Qwen2.5-7B-Instruct Open Source·Alibaba	September 19, 2024	7B	4.6	4.7	4.5	5.2	5.0	4.0	4.0	4.9	4.7
Gemma-2-27B-it Open Source·Google	June 27, 2024	27B	4.6	4.5	4.7	5.2	5.3	4.4	4.4	4.1	4.3
Gemma-2-9B-it Open Source·Google	June 27, 2024	9B	4.6	4.7	4.5	5.7	5.0	4.1	4.2	4.2	4.2
Baichuan4 Closed Source·Baichuan	May 22, 2024	N/A	4.5	4.3	4.7	5.0	4.5	4.0	4.3	4.0	5.2
GLM-4-9B-Chat Open Source·Zhipu AI	June 4, 2024	9B	4.5	4.6	4.5	4.6	4.1	4.0	3.9	5.2	5.5
Mistral-Small-Instruct-2409 Open Source·Mistral AI	September 17, 2024	22B	4.5	4.1	5.0	4.2	4.9	3.8	4.8	4.5	5.2
Hunyuan-Standard-256k Closed Source·Tencent	October 28, 2024	N/A	4.4	4.1	4.8	4.6	5.4	3.2	4.3	4.5	4.6
Moonshot-v1-32K Closed Source·Moonshot	September 1, 2024	N/A	4.4	5.0	3.8	5.5	4.6	4.1	2.9	5.3	3.9
Ministral-8B-Instruct-2410 Open Source·Mistral AI	October 16, 2024	8B	4.3	4.3	4.4	4.6	4.5	3.9	4.0	4.3	4.8
ERNIE-4.0-8K-Latest Closed Source·Baidu	November 15, 2024	N/A	4.2	4.7	3.8	4.9	4.5	3.8	2.7	5.4	4.2
Llama3.1-70B-Instruct Open Source·Meta	July 23, 2024	70B	4.0	2.9	5.0	3.8	5.1	2.3	4.2	2.7	5.7
360Zhinao2-7B-Chat-4K Open Source·360 Zhinao	November 21, 2024	7B	3.8	4.4	3.2	4.9	4.1	4.4	2.9	3.9	2.8
Llama3.1-8B-Instruct Open Source·Meta	July 23, 2024	8B	3.7	3.1	4.4	4.3	4.4	2.1	3.5	3.0	5.1
Llama3.2-3B-Instruct Open Source·Meta	September 25, 2024	3B	3.1	2.1	4.1	3.5	4.1	1.1	3.3	1.8	5.0