Agora Launches Conversational AI Engine and IoT Device Kit for Enhanced Voice AI Experiences

Agora Launches Conversational AI Engine for Seamless Voice AI Experiences

The new solution allows developers to use any AI model to create voice agents optimized for ultra-low latency and natural conversation flow Agora, Inc. (NASDAQ: API), a leading platform for real-time engagement APIs, today announced the launch of its Conversational AI Engine, an advanced solution enabling developers to create interactive voice experiences with any AI model. Built for seamless real-time engagement, the engine ensures ultra-low latency responses and superior voice processing, allowing for the effortless creation of immersive voice AI experiences. Agora's Conversational AI Engine provides developers with the flexibility to use any AI model, whether custom-built or from leading LLM providers, and any text-to-speech (TTS) voice solution for their AI agent. The Engine is designed to optimize real-time conversation flow. It enables faster, low-latency responses and intelligently pauses for interruptions in real time, enabling more natural dialogue with users. "Most AI models don't yet offer the ability to interact via voice, and those that do haven't optimized the experience," said Tony Zhao, CEO of Agora. "Agora's solution will help drive the adoption of conversational AI by enabling seamless, natural voice interactions. With effortless integration and real-time, voice-driven experiences that have near-zero lag, we are removing barriers and unlocking new possibilities for businesses and end users alike." With built-in background noise suppression, AI-driven acoustic algorithms, and real-time speech-to-text (STT), Agora's Conversational AI Engine ensures clear and accurate voice interactions in any environment. Powered by Agora's global Software-Defined Real-Time Network™, the Engine dynamically handles packet loss and minimizes latency, delivering exceptional performance across devices and networks. The solution is built on top of the TEN framework, an Agora-supported community project for building conversational AI. The Engine allows businesses to deploy natural and engaging real-time voice agents with maximum scalability and minimal effort. Agora also plans to extend the capabilities of the Conversational AI Engine to its App Builder product, enabling a no-code approach to creating conversational AI experiences. App Builder allows users to create a simple UI and seamlessly integrate Agora's Conversational AI Engine without extensive coding, making it possible to deploy voice-driven AI experiences even more quickly. Zhao continued, "Our goal is to bridge the gap between AI and human interaction, making conversations more intuitive, expressive, and impactful. We are dedicated to democratizing voice interactions between humans and AI models, making them a fundamental part of how people connect, communicate, and innovate." To further enhance its Conversational AI Engine, Agora is partnering with Oracle as a key AI infrastructure provider, leveraging the scalable Oracle Cloud Infrastructure (OCI) solution to optimize performance, security, and efficiency. "Agora's Conversational AI Engine solves two of the biggest hurdles in human-to-AI voice conversation -- latency and wireless last mile challenges," said Hua Jiang, Alliance & Channel Director, Oracle APAC. "We are proud to collaborate with Agora to provide the infrastructure that enables more natural, responsive, and reliable voice-powered conversational AI." Agora's Conversational AI Engine is designed for a wide range of applications, including: 24/7 Customer Support: Create AI-powered voice agents that provide instant responses, troubleshoot issues, and guide customers through processes. IoT Integration: Enable seamless voice control for smart devices, wearables, robots, and connected applications. Virtual Shopping Assistants: Help customers find products, compare options, and make purchasing decisions in real time. Live AI Hosts: Leverage AI agents to host live events, equipped with automated content moderation and the ability to respond to viewers in real time. Mental Health Support: Offer mental health support agents that can listen, provide advice, and connect users with professional help if needed. Live Tutoring: Offer AI tutoring that can speak with students to offer real-time feedback and guidance when learning specific languages or subjects. AI-Powered NPCs in Gaming: Build more immersive virtual worlds with AI-controlled characters that can interact naturally with players via voice. Employee Onboarding: Guide new hires through training and provide instant access to a 24/7 resource to answer questions. Agora's Conversational AI Engine is now available in public beta, allowing businesses and developers to start building advanced voice AI applications today. For more information, visit www.agora.io/en/products/conversational-ai-engine/. About Agora Agora is the global leader in real-time engagement, providing developers with simple, flexible, and powerful APIs to embed real-time conversational AI, voice, video, interactive live streaming, and chat into their applications and IoT devices. Headquartered in Santa Clara, CA, Agora is trusted by over 1,700 leading organizations across the globe to power best-in-class real-time experiences from social media and live shopping to education and telehealth. For more information about Agora (NASDAQ: API), visit: www.agora.io

Agora Unveils Conversational AI Engine for Ultra-Responsive Voice AI

Agora's Conversational AI Engine provides developers with the flexibility to use any AI model, whether custom-built or from leading LLM providers, and any text-to-speech (TTS) voice solution for their AI agent. The Engine is designed to optimize real-time conversation flow. It enables faster, low-latency responses and intelligently pauses for interruptions in real time, enabling more natural dialogue with users. "Most AI models don't yet offer the ability to interact via voice, and those that do haven't optimized the experience," said Tony Zhao, CEO of Agora. "Agora's solution will help drive the adoption of conversational AI by enabling seamless, natural voice interactions. With effortless integration and real-time, voice-driven experiences that have near-zero lag, we are removing barriers and unlocking new possibilities for businesses and end users alike."

Agora Launches Conversational AI Toolkit for IoT Devices

New partnerships with Beken and Robopoet showcase the future of interactive toys and connected devices Agora, Inc. (NASDAQ: API), a global leader in real-time engagement solutions, is expanding into AI-powered robotics and interactive toys with its new ConvoAI Device Kit. This breakthrough solution -- developed in partnership with chip-maker Beken -- delivers an all-in-one toolkit that empowers developers and manufacturers to create intelligent, voice-driven interactions for next-generation conversational AI in smart devices. The ConvoAI Device Kit integrates Beken's high-performance AI chip modules with Agora's Conversational AI technology, enabling ultra-low latency voice interactions, intelligent dialogue processing, and seamless real-time communication. This innovative solution is designed to make AI-driven devices, toys, and robots more interactive, intuitive, and emotionally responsive. "Conversational AI is key to making robots and AI-driven toys truly interactive, engaging, and intuitive," said Tony Zhao, CEO of Agora. "By integrating Agora's technology into Beken's chips, IoT toymakers like Robopoet will transform entertainment, education, and emotional support by enabling more natural conversations, adaptive learning, and personalized interactions that evolve with the user over time." As part of this expansion, Agora is proud to power Robopoet's latest AI companion robot, Fuzzoo, unveiled at Mobile World Congress (MWC) last week. Designed to redefine emotional wellness, Fuzzoo is an AI-powered emotional companion that listens, senses, and responds in real time. Robopoet's Multimodal Emotion Model (MEM) leverages Agora's ConvoAI Device Kit to offer personalized support and foster emotional connection. "Agora's AI technology enables toys and robots to interact in a way that feels natural and engaging," said Yuna Pan, Co-Founder and CTO of Robopoet. "With real-time voice processing, emotional AI, and advanced speech capabilities, Agora makes seamless human-machine interaction possible and ensures exceptional performance and reliability." Agora's AI device solution can be used for: Educational AI toys that support STEM learning, coding, and problem-solving Companionship devices designed for emotional interaction and support Interactive play toys with conversational AI voice and touch interactivity Smart home devices with advanced voice AI agents AI-powered wearables featuring smart AI voice interaction Agora's solution enables device makers to directly integrate AI into their devices with its Edge Chip partnership with Beken. "With Agora's conversational AI technology and our optimized AI hardware, we're enabling the next generation of devices to think, respond, and interact naturally," said Pengfei Zhang, CEO of Beken. "We are excited to usher in the future of robotics and toys, ones that can react to the environment around them and interact fluently with users." On-device conversational AI often faces challenges such as background noise affecting speech recognition, latency disrupting natural conversations, and rigid AI models limiting adaptability. Agora's Conversational AI technology overcomes these obstacles with advanced voice activity detection (VAD), real-time speech synthesis, and intelligent interruption handling, allowing for smooth and responsive interactions. These initiatives underscore Agora's vision of intelligent, responsive devices capable of real-time, human-like interactions. With cutting-edge speech recognition and the ability to connect any AI model and any voice, Agora is shaping the next generation of AI-powered devices. Learn more about Agora's ConvoAI Device Kit here: https://www.agora.io/en/products/convoai-device-kit/ About Agora Agora is the global leader in real-time engagement, providing developers with simple, flexible, and powerful APIs to embed real-time conversational AI, voice, video, interactive live streaming, and chat into their applications and IoT devices. Headquartered in Santa Clara, CA, Agora is trusted by over 1,700 leading organizations across the globe to power best-in-class real-time experiences from social media and live shopping to education and telehealth. For more information about Agora (NASDAQ: API), visit: www.agora.io

Agora Launches its Conversational AI Engine for Developers

Agora's new conversational AI engine is a new utility for developers to integrate immersive AI voice experiences. Agora, a platform for real-time engagement APIs, launched its conversational AI engine, to enable developers to create interactive voice experiences with any AI model. It is now available in public beta. The company claims the conversational AI engine is designed to provide ultra-low latency responses and superior voice processing, resulting in a seamless AI voice experience. Agora states that the technology provides developers with the flexibility to use any AI model, whether it is custom-built or from leading LLM providers, and includes support for any text-to-speech (TTS) voice solution for their AI agent. Furthermore, it is built to optimise real-time conversation flow, which enables it to give faster, low-latency responses while also pausing for interruptions in real time for a natural dialogue experience. "Most AI models don't yet offer the ability to interact via voice, and those that do haven't optimised the experience," said Tony Zhao, CEO of Agora. "Agora's solution will help drive the adoption of conversational AI by enabling seamless, natural voice interactions. With effortless integration and real-time, voice-driven experiences that have near-zero lag, we are removing barriers and unlocking new possibilities for businesses and end users alike." The company further explained that the conversational AI engine has built-in background noise suppression, AI-driven acoustic algorithms, and real-time speech-to-text (STT). It is powered by Agorda's global software-designed real-time network, which helps the engine dynamically handle packet loss and reduce latency. Agora further states that it is built on the TEN framework, an Agora-supported community project for building conversational AI. The company is also partnering with Oracle as a key AI infrastructure provider, leveraging the Oracle Cloud Infrastructure (OCI) solution to optimise performance, security, and efficiency. "Agora's Conversational AI Engine solves two of the biggest hurdles in human-to-AI voice conversation -- latency and wireless last mile challenges," said Hua Jiang, alliance & channel director, Oracle APAC. In the near future, the company plans to extend the capabilities of the conversational AI engine to its app builder product, providing a no-code approach.

Agora Partners with Beken and Robopoet to Launch ConvoAI Device Kit

Real-time voice processing and emotional AI make human-machine interaction more engaging. Agora has launched the ConvoAI Device Kit, a new solution designed to enhance real-time, AI-powered voice interactions in smart devices. Developed in collaboration with chip-maker Beken, the toolkit aims to power interactive toys, robots, and IoT devices with ultra-low latency voice processing and intelligent dialogue capabilities. "Conversational AI is key to making robots and AI-driven toys truly interactive, engaging, and intuitive," said Tony Zhao, CEO of Agora. "By integrating Agora's technology into Beken's chips, IoT toymakers like Robopoet will transform entertainment, education, and emotional support by enabling more natural conversations, adaptive learning, and personalised interactions that evolve with the user over time." The ConvoAI Device Kit is already being used in Robopoet's AI companion robot, Fuzzoo, unveiled at Mobile World Congress (MWC). Fuzzoo leverages Agora's technology to deliver real-time emotional engagement through multimodal interactions. "Agora's AI technology enables toys and robots to interact in a way that feels natural and engaging," said Yuna Pan, Co-Founder and CTO of Robopoet. "With real-time voice processing, emotional AI, and advanced speech capabilities, Agora makes seamless human-machine interaction possible and ensures exceptional performance and reliability." The solution supports a wide range of applications, from educational AI toys and smart home devices to AI-powered wearables. Pengfei Zhang, CEO of Beken, highlighted the collaboration's impact, stating, "With Agora's conversational AI technology and our optimised AI hardware, we're enabling the next generation of devices to think, respond, and interact naturally." Agora's AI technology addresses key challenges in on-device conversational AI, such as background noise, latency issues, and rigid AI models. By integrating real-time speech synthesis and intelligent interruption handling, Agora is paving the way for more fluid and human-like interactions in smart devices. Earlier this week, Agora launched its Conversational AI engines, enabling developers to create interactive voice experiences with any AI model. These conversational engines are designed to provide ultra-low latency responses and superior voice processing capabilities while allowing real-time interruptions for a more natural dialogue experience.