After teasing the launch of something "that feels like magic," ChatGPT parent OpenAI has announced its newest flagship model with more capabilities available for free in ChatGPT.

OpenAI's Chief Technology Officer Mira Murati announced the company's upgrade to ChatGPT 3.5 by announcing the new ChatGPT 4o, touted to be a smarter version of its predecessor.

"GPT-4o reasons across voice, text, and vision. And with this incredible efficiencies, it also allows us to bring the GPT-4o intelligence to our free users. This is something we have been trying to do for many, many months," said Murati at the OpenAI Spring Update event.

GPT-4o has GPT-4-level intelligence but is much faster and improves on its capabilities across text, voice, and vision.

"It’ll be free for all users, and paid users will continue to have up to five times the capacity limits of free users," added Murati.

The company claims that GPT-4o is better than any existing model at understanding and discussing images. For instance, users can simply take a picture of a menu in a different language and GPT-4o will translate it along with the food's history and significance, and give recommendations.

"In the future, improvements will allow for more natural, real-time voice conversation and the ability to converse with ChatGPT via real-time video. For example, you could show ChatGPT a live sports game and ask it to explain the rules to you. We plan to launch a new Voice Mode with these new capabilities in an alpha in the coming weeks, with early access for Plus users as we roll out more broadly," said OpenAI in a blog.

When using GPT-4o, ChatGPT Free users will now have access to features such as, GPT-4 level intelligence, responses(opens in a new window) from both the model and the web , analyses of data and charts, chats about photos you take, upload of files(opens in a new window) for assistance summarizing, writing or analyzing, use GPTs and the GPT Store and building a more helpful experience with Memory.

GPT-4o will be rolled out in phases with support of over 50 languages including Indian.