Command following AI Model Scoring List - November 2024

November 2024 Please select the month

Ranking



4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37

MODEL NAME	RELEASE DATE	PARAMETERS	instruct	instruct(ZH)	instruct(EN)
o1-mini-2024-09-12 Closed Source·OpenAI	September 12, 2024	N/A	7.5	7.4	7.6
GPT-4o-20241120 Closed Source·OpenAI	November 20, 2024	N/A	7.1	7.4	6.7
Yi-Lightning Closed Source·01.AI	October 16, 2024	N/A	6.4	6.5	6.3
Qwen2.5-72B-Instruct Open Source·Alibaba	September 19, 2024	72B	6.2	5.9	6.4
GLM-4-Plus Closed Source·Zhipu AI	August 30, 2024	N/A	5.9	6.1	5.7
Bailing-Pro-1120 Closed Source·Ant Group	November 15, 2024	N/A	5.7	5.5	5.9
Grok-beta Closed Source·xAI	August 13, 2024	N/A	5.6	5.5	5.6
abab7-chat-preview Closed Source·MiniMax	November 6, 2024	N/A	5.6	5.4	5.9
Step-2-16K Closed Source·StepFun	July 4, 2024	N/A	5.6	5.6	5.5
TeleChat2 Closed Source·TeleAI	September 26, 2024	N/A	5.6	5.7	5.5
DeepSeek-V2.5 Open Source·DeepSeek	September 5, 2024	236B	5.5	5.4	5.7
Bailing-Lite-1116 Closed Source·Ant Group	November 15, 2024	N/A	5.5	5.5	5.4
ERNIE-4.0-Turbo-8K-Latest Closed Source·Baidu	November 15, 2024	N/A	5.5	5.7	5.4
Mistral-Large-Instruct-2411 Open Source·Mistral AI	November 18, 2024	123B	5.2	5.2	5.3
360gpt2-pro Closed Source·360 Zhinao	November 29, 2024	N/A	5.2	5.4	5.1
Gemini-1.5-Pro-Latest Closed Source·Google	November 29, 2024	N/A	5.1	5.4	4.8
Claude 3.5 Sonnet 20241022 Closed Source·Anthropic	October 22, 2024	N/A	5.0	5.0	5.0
GPT-4o-20240806 Closed Source·OpenAI	August 6, 2024	N/A	5.0	5.0	5.0
Doubao-pro-32k-240828 Closed Source·ByteDance	August 28, 2024	N/A	4.9	5.6	4.3
Llama3.1-405B-Instruct-FP8 Open Source·Meta	July 23, 2024	405B	4.7	4.0	5.4
Mistral-Small-Instruct-2409 Open Source·Mistral AI	September 17, 2024	22B	4.6	4.3	4.9
Hunyuan-Standard-256k Closed Source·Tencent	October 28, 2024	N/A	4.5	4.2	4.8
Gemma-2-27B-it Open Source·Google	June 27, 2024	27B	4.5	4.7	4.4
Llama3.1-70B-Instruct Open Source·Meta	July 23, 2024	70B	4.3	3.6	5.0
Moonshot-v1-32K Closed Source·Moonshot	September 1, 2024	N/A	4.2	4.4	4.1
Qwen2.5-7B-Instruct Open Source·Alibaba	September 19, 2024	7B	4.1	3.8	4.4
Ministral-8B-Instruct-2410 Open Source·Mistral AI	October 16, 2024	8B	4.1	3.8	4.5
Gemma-2-9B-it Open Source·Google	June 27, 2024	9B	4.0	4.0	4.1
Spark-v4.0-Ultra Closed Source·iFLYTEK	June 28, 2024	N/A	3.9	3.5	4.3
Llama3.1-8B-Instruct Open Source·Meta	July 23, 2024	8B	3.9	2.9	5.0
360Zhinao2-7B-Chat-4K Open Source·360 Zhinao	November 21, 2024	7B	3.7	3.7	3.7
Yi-1.5-34B-Chat Open Source·01.AI	May 12, 2024	34B	3.5	3.6	3.4
Baichuan4 Closed Source·Baichuan	May 22, 2024	N/A	3.4	3.5	3.4
GLM-4-9B-Chat Open Source·Zhipu AI	June 4, 2024	9B	3.3	3.2	3.4
ERNIE-4.0-8K-Latest Closed Source·Baidu	November 15, 2024	N/A	3.2	3.5	3.0
Yi-1.5-9B-Chat Open Source·01.AI	May 12, 2024	9B	2.7	2.8	2.6
Llama3.2-3B-Instruct Open Source·Meta	September 25, 2024	3B	2.5	1.5	3.6