Fujitsu's PHOTON Architecture Boosts AI Performance 475x, Tackles Compute Bottlenecks
As large models continue to evolve rapidly, computing costs and processing efficiency remain key industry concerns. Fujitsu recently introduced a novel architecture called PHOTON (Top-down Network Parallel Hierarchical Computing), designed to overcome the performance limitations of traditional Transformer models in complex scenarios.
The Transformer architecture, now dominant in AI, handles long texts or high-concurrency multi-query tasks well, but often slows down due to frequent memory access for retrieving historical information, increasing GPU workload. Fujitsu's research team addressed this pain point by rethinking the PHOTON architecture's design.

PHOTON's core strength lies in its hierarchical processing approach. Instead of the token-level segmentation used by traditional Transformers, PHOTON introduces semantic layering, which cuts computational complexity while boosting parallel computing. Additionally, for multi-query tasks, the architecture streamlines decision-making: it needs only a single inference to reach a conclusion, using "majority voting" or "best choice" strategies.
Test results show that in smaller models with 600M, 900M, and 1.2B parameters, PHOTON delivers very high throughput and extremely low memory usage. In the 1.2B parameter model, its multi-query performance reaches 475 times that of mainstream Transformer architectures, significantly improving resource scheduling efficiency.
Because this architecture requires less KV Cache per iteration, the system can handle more iterations. This is a major performance boost for intelligent agent systems that manage many I/O processes. While some quality metrics see a slight trade-off, PHOTON's leap in computational efficiency makes it a promising technical solution for reducing AI operational costs.
Fujitsu is now actively promoting the architecture's application, aiming to provide lighter, more efficient underlying support for future intelligent scenarios through innovations in core algorithms.
Related article
ZTE, Tencent Forge AI Cloud Partnership with Native Work Buddy
ZTE hosted an AI Cloud Computer Experience Day in Beijing, announcing a strategic partnership with Tencent to launch a new AI cloud computer featuring Tencent’s Work Buddy. The market responded swiftly: on June 4, ZTE’s A-shares rose over 5% to 38.5
Wanxiang Shengsheng Unveils Low-Cost AI Audiobook Tool at Under 8 Yuan per 10k Characters
Two months after its public beta, Wanzhuang Yousheng officially launched its automated production system, "Fully Automatic AI Multi-voice Audiobook Creation," a feature that had already won over rights holders during internal trials.Launched by the c
How to fix Core Web Vitals for better SEO ranking
How to Build Beautiful Websites Using AI and Google SitesTable of Contents:IntroductionMastering Web Design and Creation with Google SitesThe Role of Artificial Intelligence in Modern Web DesignBuilding a Site with Google TemplatesUsing AI Tools Like
Related Special Topic Recommendations
Comments (0)
0/500
As large models continue to evolve rapidly, computing costs and processing efficiency remain key industry concerns. Fujitsu recently introduced a novel architecture called PHOTON (Top-down Network Parallel Hierarchical Computing), designed to overcome the performance limitations of traditional Transformer models in complex scenarios.
The Transformer architecture, now dominant in AI, handles long texts or high-concurrency multi-query tasks well, but often slows down due to frequent memory access for retrieving historical information, increasing GPU workload. Fujitsu's research team addressed this pain point by rethinking the PHOTON architecture's design.

PHOTON's core strength lies in its hierarchical processing approach. Instead of the token-level segmentation used by traditional Transformers, PHOTON introduces semantic layering, which cuts computational complexity while boosting parallel computing. Additionally, for multi-query tasks, the architecture streamlines decision-making: it needs only a single inference to reach a conclusion, using "majority voting" or "best choice" strategies.
Test results show that in smaller models with 600M, 900M, and 1.2B parameters, PHOTON delivers very high throughput and extremely low memory usage. In the 1.2B parameter model, its multi-query performance reaches 475 times that of mainstream Transformer architectures, significantly improving resource scheduling efficiency.
Because this architecture requires less KV Cache per iteration, the system can handle more iterations. This is a major performance boost for intelligent agent systems that manage many I/O processes. While some quality metrics see a slight trade-off, PHOTON's leap in computational efficiency makes it a promising technical solution for reducing AI operational costs.
Fujitsu is now actively promoting the architecture's application, aiming to provide lighter, more efficient underlying support for future intelligent scenarios through innovations in core algorithms.
ZTE, Tencent Forge AI Cloud Partnership with Native Work Buddy
ZTE hosted an AI Cloud Computer Experience Day in Beijing, announcing a strategic partnership with Tencent to launch a new AI cloud computer featuring Tencent’s Work Buddy. The market responded swiftly: on June 4, ZTE’s A-shares rose over 5% to 38.5
How to fix Core Web Vitals for better SEO ranking
How to Build Beautiful Websites Using AI and Google SitesTable of Contents:IntroductionMastering Web Design and Creation with Google SitesThe Role of Artificial Intelligence in Modern Web DesignBuilding a Site with Google TemplatesUsing AI Tools Like





Home






