HomeOpenAI Faces Backlash Over Vibe-Graphing Technology
During its major GPT-5 livestream on Thursday, OpenAI presented several charts that appeared to showcase the model’s impressive capabilities—but a closer look reveals some inconsistencies in the data visualization.
Ironically, in one chart illustrating GPT-5’s performance in "deception evals across models," the scale seems misaligned. For instance, the onstage graphic claimed that GPT-5 with "thinking" achieved a 50.0 percent deception rate. Yet, OpenAI's smaller o3 model—with a reported 47.4 percent—appeared as a larger bar. The data published in OpenAI’s official GPT-5 blog post, however, shows GPT-5’s actual deception rate at 16.5 percent.
This visual mismatch meant that onstage, GPT-5’s bar was shown as taller than o3’s, even though its reported score was lower. Elsewhere in the same chart, o3 and GPT-4o received different scores but were represented by bars of identical size. The error was significant enough for CEO Sam Altman to publicly acknowledge it, labeling the incident a "mega chart screwup," while clarifying that the blog contained the correct version.
An OpenAI marketing staff member also apologized, stating, "We fixed the chart in the blog, everyone—sorry for the unintentional chart crime."
On Friday, responding to a Reddit user’s query about the graphs, Altman explained that “the numbers here were accurate, but we messed up the bar charts during the livestream. On another slide, we got the numbers wrong.” He confirmed that the blog post and system card data were accurate, adding that “team members were working late and exhausted, which led to human error. It all comes together last-minute for a livestream.”
Still, the errors presented an unfortunate look for the company on such an important launch day—especially as it promotes the new model's “significant advances in reducing hallucinations.”
Updated August 8th: Added Altman's Reddit comment.
Related article
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
OpenAI launches GPT-5.5 Instant as ChatGPT’s new default model
OpenAI launched GPT-5.5 Instant on Monday, replacing GPT-5.3 Instant as the default ChatGPT model. The company states that this update minimizes hallucinations in high-stakes fields like law, medicine, and finance, while preserving the fast response
Nvidia to Derive 25% of Next Year’s Revenue from Funded Labs
Nvidia has deployed nearly US$50 billion into AI labs purchasing its chips, securing commitments for over $500 billion in total.On August 26, CFO Colette Kress informed analysts that these labs, backed by Nvidia’s balance sheet, will account for roug
Related Special Topic Recommendations
Design & Art
Top AI Illustration Tools: Create Editorial Scenes and Cover Art Faster
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
Education and Learning
Top AI Tutors for Exam Prep: Practice Math, Science, and English
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
Finance
AI Budget Planning Tools for Personal Money Management
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
Health & Wellness
AI Sleep Tracking Assistants: Improve Recovery with Better Bedtime Habits
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
Data Analysis
AI SQL Copilots for Product and Revenue Analytics
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
Education and Learning
Best AI Homework Helpers That Teach: Learn Concepts, Not Just Answers
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Comments (1)
0/500
![GregoryWilson]()
GPT-5のライブストリームで公開されたグラフ、データ可視化に不整合があるって話か。OpenAIの「Vibe-Graphing」技術って、結局は適当に描いたチャートを見栄えよく見せるだけなの？技術の進歩より、透明性が欠如してるように見えるけど、ユーザーとしては正直なデータ表示を期待したいな。😅
During its major GPT-5 livestream on Thursday, OpenAI presented several charts that appeared to showcase the model’s impressive capabilities—but a closer look reveals some inconsistencies in the data visualization.
Ironically, in one chart illustrating GPT-5’s performance in "deception evals across models," the scale seems misaligned. For instance, the onstage graphic claimed that GPT-5 with "thinking" achieved a 50.0 percent deception rate. Yet, OpenAI's smaller o3 model—with a reported 47.4 percent—appeared as a larger bar. The data published in OpenAI’s official GPT-5 blog post, however, shows GPT-5’s actual deception rate at 16.5 percent.
This visual mismatch meant that onstage, GPT-5’s bar was shown as taller than o3’s, even though its reported score was lower. Elsewhere in the same chart, o3 and GPT-4o received different scores but were represented by bars of identical size. The error was significant enough for CEO Sam Altman to publicly acknowledge it, labeling the incident a "mega chart screwup," while clarifying that the blog contained the correct version.
An OpenAI marketing staff member also apologized, stating, "We fixed the chart in the blog, everyone—sorry for the unintentional chart crime."
On Friday, responding to a Reddit user’s query about the graphs, Altman explained that “the numbers here were accurate, but we messed up the bar charts during the livestream. On another slide, we got the numbers wrong.” He confirmed that the blog post and system card data were accurate, adding that “team members were working late and exhausted, which led to human error. It all comes together last-minute for a livestream.”
Still, the errors presented an unfortunate look for the company on such an important launch day—especially as it promotes the new model's “significant advances in reducing hallucinations.”
Updated August 8th: Added Altman's Reddit comment.
Sequoia-backed Empirik raises $21M to forecast outages before they strike
Before joining Sequoia Capital in 2020 as chief digital and information officer, Avon Puri spent over a decade running infrastructure at Rubrik and VMware. Three years ago, as large language models began showing their true potential, Puri, alongside
OpenAI launches GPT-5.5 Instant as ChatGPT’s new default model
OpenAI launched GPT-5.5 Instant on Monday, replacing GPT-5.3 Instant as the default ChatGPT model. The company states that this update minimizes hallucinations in high-stakes fields like law, medicine, and finance, while preserving the fast response
Nvidia to Derive 25% of Next Year’s Revenue from Funded Labs
Nvidia has deployed nearly US$50 billion into AI labs purchasing its chips, securing commitments for over $500 billion in total.On August 26, CFO Colette Kress informed analysts that these labs, backed by Nvidia’s balance sheet, will account for roug
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
GPT-5のライブストリームで公開されたグラフ、データ可視化に不整合があるって話か。OpenAIの「Vibe-Graphing」技術って、結局は適当に描いたチャートを見栄えよく見せるだけなの？技術の進歩より、透明性が欠如してるように見えるけど、ユーザーとしては正直なデータ表示を期待したいな。😅
