Close Menu

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    SpaceX Starship Rocket Explodes During Ground Test at Texas Launch Site

    June 21, 2025

    Anthropic Warns: Most Advanced AI Models Resort to Harmful Behavior in Stress Tests

    June 21, 2025

    Meta and Oakley Launch AI-Driven Smart Glasses with 3K Video and Extended Battery Life

    June 20, 2025
    Facebook X (Twitter) Instagram Pinterest
    EchoCraft AIEchoCraft AI
    • Home
    • AI
    • Apps
    • Smart Phone
    • Computers
    • Gadgets
    • Live Updates
    • About Us
      • About Us
      • Privacy Policy
      • Terms & Conditions
    • Contact Us
    EchoCraft AIEchoCraft AI
    Home»AI»OpenAI Introduces New Audio Models in API for Speech-Based AI Applications
    AI

    OpenAI Introduces New Audio Models in API for Speech-Based AI Applications

    EchoCraft AIBy EchoCraft AIMarch 21, 2025No Comments3 Mins Read
    Share Facebook Twitter Pinterest LinkedIn Tumblr Reddit Telegram Email
    Share
    Facebook Twitter LinkedIn Pinterest Email

    OpenAI has introduced three new artificial intelligence models designed to enhance speech-to-text and text-to-speech capabilities.

    These models—GPT-4o-transcribe, GPT-4o-mini-transcribe, and GPT-4o-mini-tts—are integrated into OpenAI’s API and are aimed at improving accuracy and reliability for real-world applications.

    While they are expected to outperform OpenAI’s previous Whisper models, they are not open-source.

    Advancing AI-Powered Voice Interaction

    The San Francisco-based AI company states that these models align with its broader goal of enabling more intuitive, multimodal AI interactions.

    OpenAI has previously developed AI agents such as Operator, Deep Research, and the Responses API, which focus on automating tasks and streamlining workflows. The latest update expands on this approach, allowing AI to process and generate speech with greater precision.

    One key improvement in the new speech-to-text models is their enhanced performance on the Few-shot Learning Evaluation of Universal Representations of Speech (FLEURS) benchmark, which assesses AI models across 100 languages.

    OpenAI reports that its latest models demonstrate lower word error rates (WER), particularly in challenging conditions such as background noise, diverse accents, and varying speech speeds.

    Performance Comparison Dashboard

    These advancements are attributed to refined training techniques, including reinforcement learning and expanded datasets.

    Natural-Sounding Text-to-Speech Capabilities

    The GPT-4o-mini-tts model introduces enhancements in text-to-speech synthesis, offering more natural-sounding voices.

    According to OpenAI, the model supports customizable inflections, intonations, and emotional expressiveness, making it suitable for applications like virtual assistants, customer service solutions, and interactive storytelling.

    The model currently offers only preset synthetic voices, without the ability for users to generate custom voices.

    Pricing Structure for Developers

    OpenAI has established different pricing tiers for its new models:

    • GPT-4o-based audio models:
      • $40 per million input tokens
      • $80 per million output tokens
    • GPT-4o-mini models:
      • $10 per million input tokens
      • $20 per million output tokens

    This structured pricing model provides developers with scalable options for integrating AI-driven speech capabilities into their applications.

    Technical Innovations Enhancing Performance

    The new GPT-4o and GPT-4o-mini audio models incorporate several advancements:

    • Pretraining with High-Quality Audio Datasets – Extensive training on diverse speech datasets has improved the models’ ability to handle various audio-related tasks with higher accuracy.
    • Advanced Distillation Techniques – Knowledge transfer from larger models to smaller, more efficient ones enhances performance while preserving conversational realism.
    • Reinforcement Learning Integration – The use of reinforcement learning further refines transcription accuracy, making these models competitive in complex speech recognition scenarios.

    Availability

    The new models are now accessible via OpenAI’s API, with additional support available through the Agents SDK, which helps developers build voice-based AI applications.

    OpenAI plans to continue refining its speech-processing technology, exploring ways to enable more personalized experiences through custom voice capabilities while maintaining ethical AI practices.

    OpenAI is collaborating with policymakers, researchers, developers, and content creators to address the challenges associated with synthetic voice technologies, reinforcing its commitment to responsible AI development.

    AI API OpenAI text-to-speech
    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    Previous ArticleSamsung Expands One UI 7 Rollout to Galaxy S21, S22, and More
    Next Article WhatsApp Developing AI-Powered Rewrite Feature and Two-Way Voice Chats with Meta AI
    EchoCraft AI

    Related Posts

    AI

    Anthropic Warns: Most Advanced AI Models Resort to Harmful Behavior in Stress Tests

    June 21, 2025
    AI

    Meta and Oakley Launch AI-Driven Smart Glasses with 3K Video and Extended Battery Life

    June 20, 2025
    AI

    YouTube Shorts to Integrate Google’s Veo 3 AI Video Model With Audio Support

    June 20, 2025
    Add A Comment
    Leave A Reply Cancel Reply

    Search
    Top Posts

    Samsung Galaxy S25 Rumours of A New Face in 2025

    March 19, 2024374 Views

    CapCut Ends Free Cloud Storage, Introduces Paid Plans Starting August 5

    July 12, 2024173 Views

    The Truth Behind Zepp Aura Health Tracking

    May 4, 2024153 Views
    Categories
    • AI
    • Apps
    • Computers
    • Gadgets
    • Gaming
    • Innovations
    • Live Updates
    • Science
    • Smart Phone
    • Social Media
    • Tech News
    • Uncategorized
    Latest in AI
    AI

    Anthropic Warns: Most Advanced AI Models Resort to Harmful Behavior in Stress Tests

    EchoCraft AIJune 21, 2025
    AI

    Meta and Oakley Launch AI-Driven Smart Glasses with 3K Video and Extended Battery Life

    EchoCraft AIJune 20, 2025
    AI

    YouTube Shorts to Integrate Google’s Veo 3 AI Video Model With Audio Support

    EchoCraft AIJune 20, 2025
    AI

    Midjourney Launches V1, Its First AI Video Generation Model

    EchoCraft AIJune 19, 2025
    AI

    Google’s Gemini “Panicked” While Playing Pokémon

    EchoCraft AIJune 18, 2025

    Subscribe to Updates

    Get the latest tech news from FooBar about tech, design and biz.

    Stay In Touch
    • Facebook
    • YouTube
    • Twitter
    • Instagram
    • Pinterest
    Tags
    2024 Adobe AI AI agents AI Model AI safety android Anthropic apple Apple Intelligence Apps ChatGPT Claude AI Copilot Cyberattack Elon Musk Gaming Gemini Generative Ai Google Google I/O 2025 Grok AI Hugging Face India Innovation Instagram IOS iphone Meta Meta AI Microsoft NVIDIA Open-Source AI OpenAI PC Reasoning Model Samsung Smart phones Smartphones Social Media TikTok U.S whatsapp xAI Xiaomi
    Most Popular

    Samsung Galaxy S25 Rumours of A New Face in 2025

    March 19, 2024374 Views

    Apple A18 Pro Impressive Leap in Performance

    April 16, 2024104 Views

    Samsung Urges Galaxy Users in the UK to Enable New Anti-Theft Features Amid Rising Phone Theft

    June 2, 2025102 Views
    Our Picks

    Apple Previews Major Accessibility Upgrades, Explores Brain-Computer Interface Integration

    May 13, 2025

    Apple Advances Custom Chip Development for Smart Glasses, Macs, and AI Systems

    May 9, 2025

    Cloud Veterans Launch ConfigHub to Address Configuration Challenges

    March 26, 2025

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    Facebook X (Twitter) Instagram Pinterest
    • Home
    • Contact Us
    • Privacy Policy
    • Terms & Conditions
    • About Us
    © 2025 EchoCraft AI. All Right Reserved

    Type above and press Enter to search. Press Esc to cancel.

    Manage Consent
    To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
    Functional Always active
    The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
    Preferences
    The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
    Statistics
    The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
    Marketing
    The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
    Manage options Manage services Manage {vendor_count} vendors Read more about these purposes
    View preferences
    {title} {title} {title}