Gemini-1.5-Pro VS Step-1-8K
| Model Name | Affiliated organization | Release time | Model parameter quantity | Comprehensive score |
|---|---|---|---|---|
| Gemini-1.5-Pro | September 23, 2024 | N/A | 6 | |
| Step-1-8K | StepFun | May 7, 2024 | N/A | 4.9 |
Comprehensive score
Language dialogue
Knowledge reserve
Reasoning association
Mathematical calculation
Code writing
Command following
Brief Comparison of Gemini-1.5-Pro VS Step-1-8K AI Models
Comprehensive Capability Comparison
Gemini-1.5-Pro holds the intelligence baseline. Step-1-8K loses basic cognitive abilities due to reward hacking issues.
Language Understanding Comparison
Both models are unreliable with high error rates, unsuitable for meaningful tasks.
Mathematical Reasoning Comparison
Gemini-1.5-Pro has some limitations but remains functional for simple tasks. Step-1-8K frequently fails and is ineffective for meaningful reasoning.
