OpenAI Introduces Slimmer, Cheaper GPT-4o Mini

OpenAI has announced the launch of GPT-4o Mini, a slimmed down, more affordable version of its flagship multimodal GPT-4o model. The "mini" version, which replaces the GPT-3.5 model, is designed to "significantly expand the range of applications built with AI by making intelligence much more affordable," the company said in a statement.

Free and paid users of ChatGPT, including those on the Teams plan, will have access to GPT-4o mini today, and the company plans to roll it out to enterprise customers next week.

This new model was designed to enable a broad range of tasks with its low cost and latency, the company said, including applications that require multiple model calls, large volumes of context, and real-time customer interactions. The company is supporting is "faster, cheaper" claim with some impressive benchmark test scores. The GPT-4o Mini scores 82% on the MMLU (Massive Multitask Language Understanding) benchmark for evaluating the capabilities of language models, and outperforms GPT-4 on chat preferences in the LMSYS Chatbot Arena leaderboard.

Key benchmark results for GPT-4o Mini include:

  • Reasoning Tasks: 82.0% on MMLU, compared to 77.9% for Gemini Flash and 73.8% for Claude Haiku.
  • Math and Coding Proficiency: 87.0% on MGSM (math reasoning) and 87.2% on HumanEval (coding performance), outperforming Gemini Flash and Claude Haiku.
  • Multimodal Reasoning: 59.4% on MMMU, leading Gemini Flash and Claude Haiku.

Currently, GPT-4o Mini supports text and vision inputs through the API, and the company plans to include text, image, video, and audio inputs and outputs in the future. The model features a 128K token context window and up-to-date knowledge to October 2023. The improved tokenizer shared with GPT-4o is meant to enhance cost-effectiveness for handling non-English text.

OpenAI has built comprehensive safety measures into GPT-4o Mini that align with its Preparedness Framework and voluntary commitments. More than 70 external experts evaluated GPT-4o to identify potential risks, and their insights have improved the safety of both GPT-4o and GPT-4o Mini, the company says.

GPT-4o Mini is the first model to apply OpenAI's instruction hierarchy method, which enhances its ability to resist jailbreaks, prompt injections, and system prompt extractions. This innovation makes the model's responses more reliable and safer for large-scale applications, the company says.

OpenAI isn't the first vendor to offer a lightweight versions of its main product offering. Google has Gemini Nano and Anthropic has Claude Haiku.

GPT-4o Mini is available now to ChatGPT Free, Plus, and Team users starting today, and will be accessible to enterprise users next week. Fine-tuning options for GPT-4o Mini will be available in the coming days.

For more information, visit the OpenAI site.

About the Author

John K. Waters is the editor in chief of a number of Converge360.com sites, with a focus on high-end development, AI and future tech. He's been writing about cutting-edge technologies and culture of Silicon Valley for more than two decades, and he's written more than a dozen books. He also co-scripted the documentary film Silicon Valley: A 100 Year Renaissance, which aired on PBS.  He can be reached at [email protected].

Featured

  • cloud icon with a padlock overlay set against a digital background featuring binary code and network nodes

    Cloud Security Auditing Tool Uses AI to Validate Providers' Security Assessments

    The Cloud Security Alliance has unveiled a new artificial intelligence-powered system that automates the validation of cloud service providers' (CSPs) security assessments, aiming to improve transparency and trust across the cloud computing landscape.

  • stack of gold coins disintegrates into digital particles against a dark circuit-board background with glowing AI imagery

    Report: Most Organizations See No Business Return on Gen AI Investments

    Despite $30-40 billion in enterprise spending on generative AI, 95% of organizations are seeing no business return, according to a recent report out of the MIT Media Lab.

  • stylized illustration of a desktop, laptop, tablet, and smartphone all displaying an orange AI icon

    Survey: AI Shifting from Cloud to PCs

    A recent Intel-commissioned report identifies a significant shift in AI adoption, moving away from the cloud and closer to the user. Businesses are increasingly turning to the specialized hardware of AI PCs, the survey found, recognizing their potential not just for productivity gains, but for revolutionizing IT efficiency, fortifying data security, and delivering a compelling return on investment by bringing AI capabilities directly to the edge.

  • student holding a smartphone with thumbs-up and thumbs-down icons, surrounded by abstract digital media symbols and interface elements

    Teaching Media Literacy? Start by Teaching Decision-Making

    Decision-making is a skill that must be developed — not assumed. Students need opportunities to learn the tools and practices of effective decision-making so they can apply what they know in meaningful, real-world contexts.