Tencent Cloud has released version 2.0 of its AIoT product line, aiming to simplify the construction and use of smart devices. This upgrade includes the voice intelligence system TWeTalk and the video intelligence system TWeSee.
Both are integrated into Tencent Cloud’s core AIoT platform, which handles device management, messaging, and audio/video communication. The goal is to provide enterprises with a single service integrating hardware, software, and ready-to-use multimodal capabilities.
Tencent stated that with the continuous advancement of artificial intelligence technology, connected devices are shifting from “AI-assisted” to “AI-driven.” AIoT 2.0 aims to eliminate common obstacles, such as the integration and adaptation of different system models.
AIoT 2.0 Details
TWeTalk provides voice-based AI for smart hardware, supporting features such as noise reduction, wake word detection, sound source localization, emotion recognition, and voice customization. Tencent collaborates with embedded chip and module manufacturers to improve device performance, while Tencent Cloud handles functions such as speech-to-text, text-to-speech, WeChat call processing, and conversation summarization. Enterprises can select appropriate functions based on their needs and use them as building blocks to create customized solutions.
TWeTalk is applied in fields such as toys, robotics, wearable devices, translation headsets, ordering systems, tour guide services, and AI interviews. For example, Dahua Technology uses Tencent Cloud technology in its screen-equipped cameras, allowing users to make WeChat calls without installing the WeChat app.
TWeSee focuses on what Tencent calls “visual intelligence.” TWeSee can use AI agents to compress video, extract content summaries, detect objects, and perform searches. Systems enabled with TWeSee can use Tencent Cloud’s AIoT platform or third-party cloud storage.
TWeSee’s capabilities can be applied to home security, retail, and industrial sectors. The company cites examples of using TWeSee to create “highlights” of pet activities; video searches based on text, images, or voice; and monitoring of store shelf inventory. In monitoring applications, it can detect and alert users to potential theft or other incidents and analyze customer traffic.
Practical Applications
Tencent Cloud’s AIoT 2.0 has been deployed globally. In the toy sector, Alpha Group’s Weslie 3.0 utilizes TWeTalk to add WeChat calling and other interactive features. Lu Jianning, head of the Smart Toys division at Alpha Group, stated that they hope Weslie will become a “true intelligent partner.”
Talking Tom’s “AI Tom Bud” also used TWeTalk during its North American launch. Han Chengyan, co-founder of Talking Tom’s AI business, stated that Tencent Cloud’s language technology and localized deployment were key to making this launch possible.
In the audio equipment field, Philips AVA-CN utilized TWeTalk to transform its TAT5599 headphones into a meeting assistant and portable translator. Wang Qiang, General Manager of Philips AVA China, stated that their collaboration with Tencent Cloud has elevated the product from simple audio transmission to the level of “intelligent communication.”
In the smart home field, Kaadas has integrated its smart door locks with TWeSee to improve event detection capabilities, reduce video search time, and extend battery life. Security company Gwelltimes has integrated TWeSee into its Yoosee cameras, providing intelligent event summaries and video search capabilities to over 130 million users worldwide.
In Thailand, a company integrated TWeSee into its monitoring platform in less than three months, adding features such as video highlights and creating new revenue streams from its existing system.