Mathematical calculation AI Model Scoring List - January 2025

January 2025 Please select the month

Ranking



4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41

MODEL NAME	RELEASE DATE	PARAMETERS	Mathematical calculation	Mathematical calculation(ZH)	Mathematical calculation(EN)	Reasoning Computation(ZH)	Reasoning Computation(EN)	college(ZH)	college(EN)
Gemma-2-27B-it Open Source·Google	June 27, 2024	27B	8.5	7.1	9.8	4.4	4.4	1.2	2.0
Ministral-8B-Instruct-2410 Open Source·Mistral AI	October 16, 2024	8B	8.5	6.7	1.0	3.1	3.1	1.2	8.0
InternLM2.5-Chat-7B Open Source·Shanghai AI Laboratory	July 5, 2024	7B	8.2	5.9	1.0	3.8	8.1	4.0	8.0
GLM-4-9B-Chat Open Source·Zhipu AI	June 4, 2024	9B	7.5	7.4	7.6	1.2	1.9	1.6	1.6
o1-2024-12-17 Closed Source·OpenAI	December 17, 2024	N/A	7.0	6.5	7.6	5.6	7.1	8.8	9.2
o3-mini-2025-01-31 Closed Source·OpenAI	January 31, 2025	N/A	7.0	6.5	7.6	6.0	7.4	8.0	8.4
Gemma-2-9B-it Open Source·Google	June 27, 2024	9B	6.6	4.8	8.4	2.5	3.1	1.2	1.2
DeepSeek-R1 Open Source·DeepSeek	January 20, 2025	671B	6.3	6.1	6.4	5.3	6.8	7.6	7.6
o1-mini-2024-09-12 Closed Source·OpenAI	September 12, 2024	N/A	5.3	5.1	5.4	4.1	5.8	7.2	7.6
Llama3.1-8B-Instruct Open Source·Meta	July 23, 2024	8B	4.9	6.5	3.3	0.6	1.9	4.0	8.0
QwQ-32B-Preview Open Source·Alibaba	November 28, 2024	32B	4.3	4.0	4.6	3.1	3.7	6.4	7.6
GLM-Zero-Preview Closed Source·Zhipu AI	December 31, 2024	N/A	4.2	4.2	4.2	3.1	3.8	6.4	6.8
DeepSeek-V3 Open Source·DeepSeek	December 26, 2024	671B	4.0	3.3	4.8	1.9	4.1	6.0	6.8
Doubao-1.5-pro-32k-250115 Closed Source·ByteDance	January 22, 2025	N/A	4.0	3.8	4.1	2.8	3.6	7.2	6.8
Gemini-2.0-Pro-Exp-02-05 Closed Source·Google	February 5, 2025	N/A	3.8	4.0	3.6	2.8	3.5	6.8	6.0
Gemini-2.0-Flash-001 Closed Source·Google	February 5, 2025	N/A	3.7	3.5	3.9	2.8	3.8	6.4	6.0
Llama3.2-3B-Instruct Open Source·Meta	September 25, 2024	3B	3.1	1.0	5.2	3.1	2.5	N/A	8.0
Qwen2.5-Max Closed Source·Alibaba	January 28, 2025	N/A	2.9	2.6	3.2	1.6	2.2	4.8	6.4
ERNIE-4.0-Turbo-8K-Latest Closed Source·Baidu	November 15, 2024	N/A	2.8	2.2	3.3	7.5	4.1	3.6	4.4
Hunyuan-Large-250210 Closed Source·Tencent	February 10, 2024	N/A	2.7	2.5	2.9	1.1	1.4	4.8	6.0
Bailing-Pro-1120 Closed Source·Ant Group	November 20, 2024	N/A	2.6	2.2	3.0	1.0	1.6	4.8	5.6
Qwen2.5-72B-Instruct Open Source·Alibaba	September 19, 2024	72B	2.6	2.3	3.0	8.8	1.9	5.2	5.6
Spark-v4.0-Ultra Closed Source·iFLYTEK	June 28, 2024	N/A	2.5	2.4	2.5	9.4	1.2	4.0	4.4
MiniMax-Text-01 Open Source·MiniMax	January 15, 2025	456B	2.4	1.7	3.2	6.9	1.3	4.4	6.0
Claude 3.5 Sonnet 20241022 Closed Source·Anthropic	October 22, 2024	N/A	2.4	2.1	2.7	1.2	1.5	3.6	5.2
GPT-4o-20241120 Closed Source·OpenAI	November 20, 2024	N/A	2.3	2.6	2.0	8.1	1.5	5.6	3.6
Bailing-Lite-1116 Closed Source·Ant Group	November 16, 2024	N/A	2.3	1.6	3.0	1.1	1.5	3.2	5.6
GPT-4o-mini-20240718 Closed Source·OpenAI	July 18, 2024	N/A	2.3	2.2	2.4	1.1	1.5	4.4	4.4
Qwen2.5-7B-Instruct Open Source·Alibaba	September 19, 2024	7B	2.3	2.2	2.5	7.5	1.0	4.4	4.0
Step-2-16k-Exp Closed Source·StepFun	January 16, 2025	N/A	2.2	2.2	2.2	8.8	9.4	4.8	4.4
GLM-4-Plus Closed Source·Zhipu AI	August 30, 2024	N/A	2.2	1.8	2.5	6.9	1.0	4.4	5.2
Yi-Lightning Closed Source·01.AI	October 16, 2024	N/A	2.1	1.8	2.4	5.0	5.0	4.0	4.4
Mistral-Large-Instruct-2411 Open Source·Mistral AI	November 18, 2024	123B	2.1	2.4	1.8	8.1	1.1	4.4	4.0
Llama3.1-405B-Instruct-FP8 Open Source·Meta	July 23, 2024	70B	1.8	2.1	1.4	5.0	6.2	4.0	2.8
InternLM3-8B-Instruct Open Source·Shanghai AI Laboratory	January 15, 2025	8B	1.7	1.8	1.6	9.4	7.5	3.2	2.8
Moonshot-v1-32K Closed Source·Moonshot	September 1, 2024	N/A	1.7	1.7	1.7	6.2	4.4	3.2	3.2
Mistral-Small-Instruct-2409 Open Source·Mistral AI	September 17, 2024	22B	1.2	1.1	1.3	6.2	6.2	2.8	2.8
Yi-1.5-34B-Chat Open Source·01.AI	May 12, 2024	34B	1.2	1.4	9.5	3.1	4.4	3.6	2.4
360Zhinao2-7B-Chat-4K Open Source·360 Zhinao	November 21, 2024	7B	1.2	8.3	1.5	5.0	6.2	2.0	3.6
Llama3.1-70B-Instruct Open Source·Meta	July 23, 2024	70B	1.1	7.1	1.6	4.4	6.9	1.2	3.6
Yi-1.5-9B-Chat Open Source·01.AI	May 12, 2024	9B	1.1	9.6	1.3	3.8	3.8	2.0	2.8