6 ways OpenAI just supercharged ChatGPT for free users

Since OpenAI introduced ChatGPT in late November 2022, the free version has largely remained the same, sticking with the GPT-3.5 model and the same user interface. But now, OpenAI is rolling out some exciting updates that are set to enhance the user experience with the chatbot significantly.

At a live-streamed event on Monday, OpenAI unveiled major enhancements for the free version of ChatGPT, introducing a suite of new multimodal capabilities. This includes advanced voice and image assistance, which promises to take user interaction to the next level.

Here's a breakdown of what these updates mean for you:

GPT-4o

The highlight of the event was the launch of GPT-4o, OpenAI's latest flagship large language model. This model not only matches the intelligence of GPT-4 but also brings faster processing and enhanced multimodal capabilities across text, voice, and vision.

We're opening up access to our new flagship model, GPT-4o, and features like browse, data analysis, and memory to everyone for free (with limits). https://t.co/H2dB6w7Ynz

— OpenAI (@OpenAI) May 13, 2024

This upgrade not only introduces new features like an enhanced Voice Mode and support for more languages but also extends many premium features previously exclusive to ChatGPT Plus subscribers to free users. Now, everyone can tap into GPT-4 level intelligence, browse the web via ChatGPT Browse with Bing, analyze data, discuss photos and documents, use GPTs, and explore the GPT Store—all without paying the $20 monthly fee for ChatGPT Plus.

However, ChatGPT Plus users still have their perks, including five times the capacity of free users, priority access to GPT-4o, and the new macOS app. Free users will be switched back to GPT-3.5 when GPT-4o is at full capacity.

GPT-4o is currently rolling out to ChatGPT Plus and Team users, with Enterprise users next in line. Free users will also get access, though with certain limitations on usage.

New Voice Mode

The live demo of the new Voice Mode, enhanced by GPT-4o's video and audio capabilities, was a showstopper. This updated mode promises more natural and interactive conversations. Users can now interrupt the chatbot and enjoy a variety of voices, from singing to dramatic robotic tones, as demonstrated in the livestream.

Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: https://t.co/MYHZB79UqN
Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks. pic.twitter.com/uuthKZyzYx

— OpenAI (@OpenAI) May 13, 2024

The AI can now incorporate environmental context into its responses, such as commenting on your surroundings or translating conversations between different languages, making it incredibly useful for real-world applications like identifying landmarks or translating menus on the go.

The enhanced Voice Mode will be available in alpha in the coming weeks, with early access for ChatGPT Plus users.

Upload Screenshots, Photos, and Documents

With GPT-4o, users can now upload images and documents alongside text to gain AI insights. This feature, previously limited to ChatGPT Plus subscribers, is a game-changer, especially since it was one of the few capabilities offered by other mainstream chatbots like Anthropic's Claude.

Whether you're uploading a PDF of a research paper or a legal document, you can ask ChatGPT for summaries or detailed questions. The image feature also helps with tasks like solving math equations from a worksheet or identifying plants from photos.

Expanded Languages

GPT-4o supports over 50 languages, significantly broadening ChatGPT's accessibility and enhancing its translation capabilities. This update not only caters to a global audience but also improves the chatbot's utility for everyday users needing language assistance.

New Browser Interface and App

Since its launch, ChatGPT's user interface has remained unchanged—until now. OpenAI has introduced a "simplified look and feel" that's both friendlier and more conversational. The new home screen and message layout offer a cleaner, more streamlined appearance.

Additionally, a new macOS app is being rolled out to ChatGPT Plus users today, with broader availability in the coming weeks. Windows users can expect their version later this year.

GPT Store Access

GPTs, or custom ChatGPT chatbots designed for specific tasks, have replaced the older ChatGPT plugins. With over three million GPTs available on the GPT Store, users can now customize their chatbot experience and integrate AI with various applications. For instance, Canva's GPT allows users to design projects directly within the chatbot, while Wolfram's GPT helps with math problems.