Alibaba releases Qwen-Audio-3.0-Realtime; voice AI can proactively call tools to get things done

robot
Abstract generation in progress

According to Beating monitoring, Alibaba has released the real-time speech model Qwen-Audio-3.0-Realtime. It can respond at millisecond level and can proactively call external tools such as maps, APIs, MCP, and knowledge bases during conversations.

Users don’t need to explicitly say “call tools.” For example, if you first ask for nearby Sichuan restaurants and then ask which one has a higher rating and is closer, the model will remember the results from the last query and continue searching and answering.

The model can also speak while listening, allowing users to interrupt at any time. In noisy environments or when multiple people are talking, it will try to identify the main speaker, reducing the chances of being mistakenly interrupted by background noise.

Speech can also adjust its tone, pace, and emotion according to the context. The official offers a Plus version with stronger reasoning and a Flash version with faster responses—both are already live on Alibaba Cloud Bailian.

View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned