OpenAI unveils voice intelligence capabilities in its API

OpenAI announced on Thursday that its API now includes several new voice intelligence features, designed to help developers build apps capable of speaking, transcribing, and translating conversations.
The company's new GPT‑Realtime‑2 is another voice model, built to produce a realistic vocal simulation that can engage in conversation with users. However, unlike its predecessor (GPT‑Realtime‑1.5), this version incorporates GPT‑5‑class reasoning, which OpenAI says was developed to handle more complex user requests.
The company is also releasing GPT‑Realtime‑Translate, which — as the name suggests — offers real‑time translation services that keep pace with the user during conversations. This feature supports over 70 input languages (languages it can understand) and 13 output languages (languages it speaks back).
Finally, the company has introduced a new transcription capability called GPT‑Realtime‑Whisper, which provides live speech‑to‑text functionality that captures words as interactions happen.
“Together, the models we are launching move real‑time audio from simple call‑and‑response toward voice interfaces that can actually do work: listen, reason, translate, transcribe, and take action as a conversation unfolds,” the company said.
Who will benefit from these updates? Companies looking to expand customer service capabilities are an obvious audience. However, OpenAI also notes that the new features will support a wide range of areas, including education, media, events, and creator platforms.
As useful as these tools may be from an enterprise perspective, there is also potential for misuse. The company says it has built guardrails to prevent its new features from being abused for spam, fraud, or other forms of online abuse. Specific triggers have been embedded in the system so that “conversations can be halted if they are detected as violating our harmful content guidelines,” according to OpenAI.
All the new voice models are included in OpenAI’s Realtime API. Translate and Whisper are billed per minute, while GPT‑Realtime‑2 is billed based on token consumption.
Related article
PHP Armageddon: OpenAI, Google’s Wiz uncover ancient holes, sparking internet panic
The U.S. National Security Agency issued a critical alert on Wednesday regarding two severe vulnerabilities in PHP, for which patches have already been released by the PHP Foundation.As a server-side scripting language, PHP powers approximately 70% o
OpenAI launches GPT-5.5 Instant as ChatGPT’s new default model
OpenAI launched GPT-5.5 Instant on Monday, replacing GPT-5.3 Instant as the default ChatGPT model. The company states that this update minimizes hallucinations in high-stakes fields like law, medicine, and finance, while preserving the fast response
Nvidia to Derive 25% of Next Year’s Revenue from Funded Labs
Nvidia has deployed nearly US$50 billion into AI labs purchasing its chips, securing commitments for over $500 billion in total.On August 26, CFO Colette Kress informed analysts that these labs, backed by Nvidia’s balance sheet, will account for roug
Related Special Topic Recommendations
Comments (0)
0/500

OpenAI announced on Thursday that its API now includes several new voice intelligence features, designed to help developers build apps capable of speaking, transcribing, and translating conversations.
The company's new GPT‑Realtime‑2 is another voice model, built to produce a realistic vocal simulation that can engage in conversation with users. However, unlike its predecessor (GPT‑Realtime‑1.5), this version incorporates GPT‑5‑class reasoning, which OpenAI says was developed to handle more complex user requests.
The company is also releasing GPT‑Realtime‑Translate, which — as the name suggests — offers real‑time translation services that keep pace with the user during conversations. This feature supports over 70 input languages (languages it can understand) and 13 output languages (languages it speaks back).
Finally, the company has introduced a new transcription capability called GPT‑Realtime‑Whisper, which provides live speech‑to‑text functionality that captures words as interactions happen.
“Together, the models we are launching move real‑time audio from simple call‑and‑response toward voice interfaces that can actually do work: listen, reason, translate, transcribe, and take action as a conversation unfolds,” the company said.
Who will benefit from these updates? Companies looking to expand customer service capabilities are an obvious audience. However, OpenAI also notes that the new features will support a wide range of areas, including education, media, events, and creator platforms.
As useful as these tools may be from an enterprise perspective, there is also potential for misuse. The company says it has built guardrails to prevent its new features from being abused for spam, fraud, or other forms of online abuse. Specific triggers have been embedded in the system so that “conversations can be halted if they are detected as violating our harmful content guidelines,” according to OpenAI.
All the new voice models are included in OpenAI’s Realtime API. Translate and Whisper are billed per minute, while GPT‑Realtime‑2 is billed based on token consumption.
PHP Armageddon: OpenAI, Google’s Wiz uncover ancient holes, sparking internet panic
The U.S. National Security Agency issued a critical alert on Wednesday regarding two severe vulnerabilities in PHP, for which patches have already been released by the PHP Foundation.As a server-side scripting language, PHP powers approximately 70% o
OpenAI launches GPT-5.5 Instant as ChatGPT’s new default model
OpenAI launched GPT-5.5 Instant on Monday, replacing GPT-5.3 Instant as the default ChatGPT model. The company states that this update minimizes hallucinations in high-stakes fields like law, medicine, and finance, while preserving the fast response
Nvidia to Derive 25% of Next Year’s Revenue from Funded Labs
Nvidia has deployed nearly US$50 billion into AI labs purchasing its chips, securing commitments for over $500 billion in total.On August 26, CFO Colette Kress informed analysts that these labs, backed by Nvidia’s balance sheet, will account for roug





Home






