HomeMeituan Unveils LongCat-Next AI Model with Unified Vision and Speech Architecture
On April 3, the MiTi team officially launched the native multimodal large model LongCat-Next. This model moves beyond the conventional "language foundation plus plugins" approach by converting images, audio, and text into a unified stream of discrete tokens. This allows the AI to natively "see" and "hear" the physical world, processing these inputs just as it does text.
Technical Core: DiNA Architecture Enables "Modality Internalization"
To eliminate barriers between different data types, MiTi developed the DiNA (Discrete Native Autoregressive) architecture, achieving a deep unification in multimodal modeling:
Complete Modality Unification: The model uses the same parameters, attention mechanisms, and loss functions for text, images, and audio.
Symmetry of Understanding and Generation: Within a single mathematical framework, predicting the next text token constitutes "understanding," while predicting an image token is "generation." Both processes show significant synergistic benefits during training.
Extreme Compression: Utilizing the dNaViT Visual Tokenizer, it handles inputs at any resolution. Through an 8-layer residual vector quantization process, it achieves up to 28x compression in pixel space while preserving critical details for tasks like OCR and financial document analysis.
Empirical Performance: Discrete Modeling Has No Inherent Limits
LongCat-Next delivers performance that surpasses specialized models across multiple benchmarks, effectively challenging the traditional notion that "discretization inevitably causes information loss":
Fine-Grained Perception: On the OmniDocBench for dense text scenarios, it outperforms not only Qwen3-Omni but also the specialized vision model Qwen3-VL.
Visual Reasoning: It scored an impressive 83.1 on MathVista, demonstrating robust, industry-grade logical reasoning.
Cross-Modal Collaboration: While maintaining leading language capabilities (C-Eval 86.80), it supports low-latency parallel generation of text and speech, along with customizable voice cloning.
Industry Insight: A Foundation for Physical-World AI
Large language models have long been centered on text. The breakthrough of LongCat-Next is its proof that physical-world information can be discretized and modeled like language. When an AI possesses a unified "native language," it becomes more intelligent and intuitive when using tools, writing code, or interpreting complex charts.
MiTi has now open-sourced the LongCat-Next model and the dNaViT tokenizer. This efficient, high-potential native discrete architecture provides developers with essential tools for building AI that can perceive and interact with the real world.
Related article
Ctrip Business Travel Unveils AI Ecosystem with 7 Industry Agents and 17 Core Capabilities
Ctrip Business Travel has officially unveiled the "Ctrip Business Travel AI Ecosystem," leveraging large language models to fundamentally restructure corporate travel management. This comprehensive ecosystem addresses four core scenarios: travel arra
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
Related Special Topic Recommendations
Design & Art
Top AI Illustration Tools: Create Editorial Scenes and Cover Art Faster
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
Education and Learning
Top AI Tutors for Exam Prep: Practice Math, Science, and English
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
Finance
AI Budget Planning Tools for Personal Money Management
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
Health & Wellness
AI Sleep Tracking Assistants: Improve Recovery with Better Bedtime Habits
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
Data Analysis
AI SQL Copilots for Product and Revenue Analytics
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
Education and Learning
Best AI Homework Helpers That Teach: Learn Concepts, Not Just Answers
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Comments (2)
0/500
![JoeGarcía]()
美团这个LongCat-Next有点东西，直接把图音文打包成统一离散流，省了插件的麻烦。虽然还没实测，但这种端到端的架构要是真能跑通，对多模态应用算是个突破。期待看看实际推理速度和成本能不能打，别又是PPT技术就行😂
![CharlesHernández]()
Interesting approach! Unifying vision and speech into a single stream sounds like a step towards more 'native' multimodal understanding, unlike just bolting on separate modules. Makes me wonder how this affects real-time processing efficiency for delivery robots or AR navigation apps. Could be a game-changer for Meituan's on-demand services if it works smoothly in the wild. 🧐
On April 3, the MiTi team officially launched the native multimodal large model LongCat-Next. This model moves beyond the conventional "language foundation plus plugins" approach by converting images, audio, and text into a unified stream of discrete tokens. This allows the AI to natively "see" and "hear" the physical world, processing these inputs just as it does text.
Technical Core: DiNA Architecture Enables "Modality Internalization"
To eliminate barriers between different data types, MiTi developed the DiNA (Discrete Native Autoregressive) architecture, achieving a deep unification in multimodal modeling:
Complete Modality Unification: The model uses the same parameters, attention mechanisms, and loss functions for text, images, and audio.
Symmetry of Understanding and Generation: Within a single mathematical framework, predicting the next text token constitutes "understanding," while predicting an image token is "generation." Both processes show significant synergistic benefits during training.
Extreme Compression: Utilizing the dNaViT Visual Tokenizer, it handles inputs at any resolution. Through an 8-layer residual vector quantization process, it achieves up to 28x compression in pixel space while preserving critical details for tasks like OCR and financial document analysis.
Empirical Performance: Discrete Modeling Has No Inherent Limits
LongCat-Next delivers performance that surpasses specialized models across multiple benchmarks, effectively challenging the traditional notion that "discretization inevitably causes information loss":
Fine-Grained Perception: On the OmniDocBench for dense text scenarios, it outperforms not only Qwen3-Omni but also the specialized vision model Qwen3-VL.
Visual Reasoning: It scored an impressive 83.1 on MathVista, demonstrating robust, industry-grade logical reasoning.
Cross-Modal Collaboration: While maintaining leading language capabilities (C-Eval 86.80), it supports low-latency parallel generation of text and speech, along with customizable voice cloning.
Industry Insight: A Foundation for Physical-World AI
Large language models have long been centered on text. The breakthrough of LongCat-Next is its proof that physical-world information can be discretized and modeled like language. When an AI possesses a unified "native language," it becomes more intelligent and intuitive when using tools, writing code, or interpreting complex charts.
MiTi has now open-sourced the LongCat-Next model and the dNaViT tokenizer. This efficient, high-potential native discrete architecture provides developers with essential tools for building AI that can perceive and interact with the real world.
Ctrip Business Travel Unveils AI Ecosystem with 7 Industry Agents and 17 Core Capabilities
Ctrip Business Travel has officially unveiled the "Ctrip Business Travel AI Ecosystem," leveraging large language models to fundamentally restructure corporate travel management. This comprehensive ecosystem addresses four core scenarios: travel arra
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
美团这个LongCat-Next有点东西，直接把图音文打包成统一离散流，省了插件的麻烦。虽然还没实测，但这种端到端的架构要是真能跑通，对多模态应用算是个突破。期待看看实际推理速度和成本能不能打，别又是PPT技术就行😂
Interesting approach! Unifying vision and speech into a single stream sounds like a step towards more 'native' multimodal understanding, unlike just bolting on separate modules. Makes me wonder how this affects real-time processing efficiency for delivery robots or AR navigation apps. Could be a game-changer for Meituan's on-demand services if it works smoothly in the wild. 🧐
