PARAS MADAN
All writing

Latest in AI

Qwen-Audio-3.1-ASR Explained: Diarization, Streaming and API Limits

Alibaba's new technical report extends transcription into speaker-aware audio analysis, but the five model profiles expose different capabilities.

Alibaba published the Qwen-Audio-3.1-ASR technical report on October 20, 2026. It describes improved speech recognition alongside speaker-diarized transcription and broader audio understanding. The main integration detail is easy to miss: these capabilities belong to different variants, and the richer analysis is not available through the streaming profiles.

This is a technical-report release. It should not be read as proof that every described model became generally available through an API on that date.

What changed from Qwen-Audio-3.0-ASR

The report retains support for 30 languages and 16 Chinese dialects. The major additions are structured transcripts with speaker labels and timestamps, plus a Next variant that can interpret sounds beyond spoken words.

Speaker diarization answers who spoke when. Here, labels are local to a recording rather than verified identities. The output can represent overlapping speech, which matters when a meeting transcript would otherwise flatten two people into one sequence of words.

General audio understanding includes captioning, locating sound events in time and answering questions about a recording. A transcript alone cannot preserve all of that information.

Which Qwen-Audio-3.1 variant supports each feature?

The report describes five deployment profiles. All support speech recognition, context and hotword controls, but they do not expose the same outputs.

ProfileIntended workflowSpeaker diarizationGeneral audio understanding
Flash-FiletransAsynchronous file transcriptionNoNo
Flash-StreamingLive transcriptionNoNo
Flash-MessageInteractive voice inputNoNo
FlashNon-streaming transcriptionYesNo
NextNon-streaming audio analysisYesYes

Streaming transcription is not streaming speaker diarization. A meeting product should not select a variant solely because its name sounds faster, then assume it includes the richer output format.

For example, a product could use a live transcript for immediate captions and a separate non-streaming pass for the structured record. That introduces another processing step, but makes the difference between provisional display and final analysis explicit.

Context, hotwords and transcription polishing

The project page explains how previous text and prioritized hotword lists help resolve specialized names. Its P0 and P1 tiers distinguish high-confidence vocabulary from a wider candidate set.

Native polishing is available in the Message, Flash and Next profiles. It can remove repetitions and organize spoken language without a separate rewriting-model call. This is useful for voice input, but edited prose and a verbatim record serve different purposes.

The project's evaluation illustrates that tradeoff: readability increases from 2.53 to 3.44, while faithfulness is 3.44 against 3.51 for the unpolished transcript. Those are the authors' evaluation scores, not a universal guarantee of accuracy.

It also reports 100ms first-character latency for Flash-Message in one comparison. Qwen ran on a self-hosted H100 service while the comparison system used an API, with comparable network delay assumed. That result should not become a promised latency for an application using a different endpoint.

What the API documentation confirms

Alibaba's file-transcription API reference explicitly names qwen-audio-3.1-asr-flash-filetrans. It uses an asynchronous submit-and-poll flow: submit a task, keep its task ID and query for completion.

One integration detail is unusually consequential. The parameters object is required for that model, even when it is empty. Omitting it can allow task submission to succeed while recognition later fails. A successful submission is therefore not enough to mark a transcript as complete.

The reference documents workspace-specific Beijing and Singapore endpoints. That does not establish that every research variant or feature is enabled in both regions. The project itself directs developers to service documentation and the console for exact identifiers and availability.

The sources reviewed here do not establish a complete public price or access matrix for all five variants. Existing prices for another Qwen or Fun-ASR model should not be substituted.

For builders, the useful change is a wider range of audio outputs under one research family. The next decision is narrower: choose the output your product actually needs, then verify that the selected service profile can produce it.

I’m Paras. I work at the intersection of AI, engineering and distribution.

I help technical founders explain AI APIs and product tradeoffs in content that developers and buyers can understand and share.

Book a 30-minute call.