Llama3.1-405B-Instruct-FP8
70B
Model parameter quantity
Meta
Affiliated organization
Open Source
License Type
July 22, 2024
Release time
Model Introduction
Llama 3.1 405B is the first openly available model that rivals the top AI models when it comes to state-of-the-art capabilities in general knowledge, steerability, math, tool use, and multilingual translation.
Comprehensive score
Language dialogue
Knowledge reserve
Reasoning association
Mathematical calculation
Code writing
Command following
Language comprehension ability
Often makes semantic misjudgments, leading to obvious logical disconnects in responses.
4.5
Knowledge coverage scope
Possesses core knowledge of mainstream disciplines, but has limited coverage of cutting-edge interdisciplinary fields.
8.7
Reasoning ability
Unable to maintain coherent reasoning chains, often causing inverted causality or miscalculations.
5.4
Model comparison
Llama3.1-405B-Instruct-FP8 vs Qwen2.5-7B-Instruct
Like Qwen2, the Qwen2.5 language models support up to 128K tokens and can generate up to 8K tokens. They also maintain multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
Llama3.1-405B-Instruct-FP8 vs Doubao-1.5-thinking-pro-250415
The new deep thinking model Doubao-1.5 performs outstandingly in professional fields such as mathematics, programming, scientific reasoning, and general tasks such as creative writing. It has reached or is close to the industry's top tier level on multiple authoritative benchmarks such as AIME 2024, Codeforces, and GPQA
Llama3.1-405B-Instruct-FP8 vs Step-1-8K
Step-1-8K is an API model produced by Step Star, with the model version number being step-1-8k.
Related model
Llama3.1-8B-Instruct
Llama3.1 are multilingual and have a significantly longer context length of 128K, state-of-the-art tool use, and overall stronger reasoning capabilities.
Llama3.2-3B-Instruct
The Llama 3.2 3B models support context length of 128K tokens and are state-of-the-art in their class for on-device use cases like summarization, instruction following, and rewriting tasks running locally at the edge.
Llama3.1-8B-Instruct
Llama3.1 are multilingual and have a significantly longer context length of 128K, state-of-the-art tool use, and overall stronger reasoning capabilities.
Llama3-70B-Instruct
Llama3 is Meta's latest open-source large language model, trained on a 15T corpus, supports an 8K context length, and has been optimized for effectiveness and safety.
Llama3.1-405B-Instruct-FP8
Llama 3.1 405B is the first openly available model that rivals the top AI models when it comes to state-of-the-art capabilities in general knowledge, steerability, math, tool use, and multilingual translation.
Relevant documents
Google's Gemini Code Assist Enhances AI Coding with New Agentic Capabilities
Gemini Code Assist, Google's AI-powered coding companion, is rolling out exciting new "agentic" features in a preview mode. At the recent Cloud Next conference, Google unveiled how
Microsoft Open-Sources Command-Line Text Editor and More at Build
Microsoft Goes All-In on Open Source at Build 2025At this year's Build 2025 conference, Microsoft made some big moves in the open-source world, releasing several key tools and appl
OpenAI Enhances AI Model Behind Its Operator Agent
OpenAI Takes Operator to the Next LevelOpenAI is giving its autonomous AI agent, Operator, a major upgrade. The upcoming changes mean Operator will soon rely on a model based on o3
Google’s AI Futures Fund may have to tread carefully
Google’s New AI Investment Initiative: A Strategic Shift Amid Regulatory ScrutinyGoogle's recent announcement of an AI Futures Fund marks a bold move in the tech giant's ongoing qu
AI YouTube Thumbnail Generator: Boost Your Video Views
The Power of AI in YouTube Thumbnail CreationIn today’s digital landscape, a captivating YouTube thumbnail is crucial for grabbing viewers’ attention. With millions of videos competing for clicks, a striking thumbnail can make all the difference. AI YouTube thumbnail generators have emerged as a gam
