Comprehensive score AI Model Scoring List - November 2024

November 2024 Please select the month

Ranking



4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37

MODEL NAME	RELEASE DATE	PARAMETERS	Comprehensive score	Language dialogue	Knowledge reserve	Reasoning association	Mathematical calculation	Code writing	Command following
o1-mini-2024-09-12 Closed Source·OpenAI	September 12, 2024	N/A	7.1	6.1	6.5	7.0	6.9	7.9	7.5
GPT-4o-20241120 Closed Source·OpenAI	November 20, 2024	N/A	6.1	6.2	7.8	6.1	5.3	5.3	7.1
Gemini-1.5-Pro-Latest Closed Source·Google	November 29, 2024	N/A	5.9	5.7	7.5	5.6	6.3	5.4	5.1
GLM-4-Plus Closed Source·Zhipu AI	August 30, 2024	N/A	5.8	6.1	7.4	5.6	5.7	4.9	5.9
Qwen2.5-72B-Instruct Open Source·Alibaba	September 19, 2024	72B	5.7	5.7	7.3	5.6	5.7	4.7	6.2
Yi-Lightning Closed Source·01.AI	October 16, 2024	N/A	5.7	6.3	7.3	5.8	5.1	4.5	6.4
Claude 3.5 Sonnet 20241022 Closed Source·Anthropic	October 22, 2024	N/A	5.6	4.9	7.8	5.7	5.0	5.7	5.0
Bailing-Pro-1120 Closed Source·Ant Group	November 15, 2024	N/A	5.6	5.9	7.3	5.7	5.5	4.4	5.7
Grok-beta Closed Source·xAI	August 13, 2024	N/A	5.4	6.0	6.0	5.8	4.8	4.8	5.6
Mistral-Large-Instruct-2411 Open Source·Mistral AI	November 18, 2024	123B	5.4	5.4	7.3	5.6	5.4	4.3	5.2
DeepSeek-V2.5 Open Source·DeepSeek	September 5, 2024	236B	5.3	5.8	6.9	5.2	5.0	4.7	5.5
360gpt2-pro Closed Source·360 Zhinao	November 29, 2024	N/A	5.3	5.0	6.5	5.2	5.6	4.6	5.2
GPT-4o-20240806 Closed Source·OpenAI	August 6, 2024	N/A	5.3	5.0	7.8	5.4	5.3	4.2	5.0
Bailing-Lite-1116 Closed Source·Ant Group	November 15, 2024	N/A	5.3	5.7	7.2	5.3	5.0	4.1	5.5
abab7-chat-preview Closed Source·MiniMax	November 6, 2024	N/A	5.2	5.0	7.3	5.5	4.8	4.3	5.6
Step-2-16K Closed Source·StepFun	July 4, 2024	N/A	5.2	5.5	7.7	5.5	4.5	4.0	5.6
TeleChat2 Closed Source·TeleAI	September 26, 2024	N/A	5.2	5.8	6.7	5.2	5.2	3.9	5.6
Doubao-pro-32k-240828 Closed Source·ByteDance	August 28, 2024	N/A	5.0	4.7	7.0	4.9	5.7	3.7	4.9
Llama3.1-405B-Instruct-FP8 Open Source·Meta	July 23, 2024	405B	5.0	4.7	7.4	5.0	5.0	4.2	4.7
ERNIE-4.0-Turbo-8K-Latest Closed Source·Baidu	November 15, 2024	N/A	5.0	5.2	6.7	4.9	4.9	4.0	5.5
Hunyuan-Standard-256k Closed Source·Tencent	October 28, 2024	N/A	4.9	4.4	7.1	4.5	5.7	3.6	4.5
Spark-v4.0-Ultra Closed Source·iFLYTEK	June 28, 2024	N/A	4.6	4.6	6.8	4.3	5.0	3.7	3.9
ERNIE-4.0-8K-Latest Closed Source·Baidu	November 15, 2024	N/A	4.5	4.2	6.6	4.6	5.2	3.6	3.2
Moonshot-v1-32K Closed Source·Moonshot	September 1, 2024	N/A	4.4	4.4	5.8	4.4	4.9	3.1	4.2
Qwen2.5-7B-Instruct Open Source·Alibaba	September 19, 2024	7B	4.3	4.6	5.6	4.4	4.6	3.3	4.1
Gemma-2-27B-it Open Source·Google	June 27, 2024	27B	4.3	4.6	5.9	4.9	3.4	3.4	4.5
Llama3.1-70B-Instruct Open Source·Meta	July 23, 2024	70B	4.2	4.0	7.1	4.2	3.8	3.3	4.3
Mistral-Small-Instruct-2409 Open Source·Mistral AI	September 17, 2024	22B	4.2	4.5	5.5	4.5	4.1	3.1	4.6
Baichuan4 Closed Source·Baichuan	May 22, 2024	N/A	3.9	4.5	5.8	4.5	3.3	3.1	3.4
Yi-1.5-34B-Chat Open Source·01.AI	May 12, 2024	34B	3.9	5.1	5.5	4.3	3.0	3.0	3.5
Gemma-2-9B-it Open Source·Google	June 27, 2024	9B	3.8	4.6	5.6	4.2	3.2	2.8	4.0
GLM-4-9B-Chat Open Source·Zhipu AI	June 4, 2024	9B	3.7	4.5	5.6	4.2	3.1	2.6	3.3
360Zhinao2-7B-Chat-4K Open Source·360 Zhinao	November 21, 2024	7B	3.7	3.8	5.2	3.8	4.1	2.3	3.7
Ministral-8B-Instruct-2410 Open Source·Mistral AI	October 16, 2024	8B	3.6	4.3	4.7	4.0	3.1	2.5	4.1
Yi-1.5-9B-Chat Open Source·01.AI	May 12, 2024	9B	3.6	4.7	5.0	3.8	3.1	3.0	2.7
Llama3.1-8B-Instruct Open Source·Meta	July 23, 2024	8B	3.3	3.7	5.5	3.7	2.8	2.0	3.9
Llama3.2-3B-Instruct Open Source·Meta	September 25, 2024	3B	2.5	3.1	4.2	3.0	2.4	1.1	2.5